English
Related papers

Related papers: Bayesian Smooth-and-Match strategy for ordinary di…

200 papers

With a Bayesian approach, the linear optics correction algorithm for storage rings is revisited. Starting from the Bayes' theorem, a complete linear optics model is simplified as "likelihood functions" and "prior probability distributions".…

Accelerator Physics · Physics 2019-04-18 Yongjun Li , Robert Rainer , Weixing Cheng

Diffusion-based generative models use stochastic differential equations (SDEs) and their equivalent ordinary differential equations (ODEs) to establish a smooth connection between a complex data distribution and a tractable prior…

Machine Learning · Computer Science 2024-08-25 Defang Chen , Zhenyu Zhou , Can Wang , Chunhua Shen , Siwei Lyu

Embedding nonlinear dynamical systems into artificial neural networks is a powerful new formalism for machine learning. By parameterizing ordinary differential equations (ODEs) as neural network layers, these Neural ODEs are…

Machine Learning · Computer Science 2024-10-28 Mikko Lehtimäki , Lassi Paunonen , Marja-Leena Linne

The method and the formula of variation of constants for ordinary differential equations (ODEs) is a fundamental tool to analyze the dynamics of an ODE near an equilibrium. It is natural to expect that such a formula works for delay…

Dynamical Systems · Mathematics 2023-10-17 Junya Nishiguchi

We derive an exact and efficient Bayesian regression algorithm for piecewise constant functions of unknown segment number, boundary location, and levels. It works for any noise and segment level prior, e.g. Cauchy which can handle outliers.…

Statistics Theory · Mathematics 2007-06-13 Marcus Hutter

We present a new framework for computing fine-scale solutions of multiscale Partial Differential Equations (PDEs) using operator learning tools. Obtaining fine-scale solutions of multiscale PDEs can be challenging, but there are many…

Numerical Analysis · Mathematics 2023-08-29 Zecheng Zhang , Christian Moya , Wing Tat Leung , Guang Lin , Hayden Schaeffer

We investigate the use of neural networks (NNs) for the estimation of hidden model parameters and uncertainty quantification from noisy observational data for inverse parameter estimation problems. We formulate the parameter estimation as a…

Numerical Analysis · Mathematics 2025-10-17 German Villalobos , Johann Rudi , Andreas Mang

Parameter identification and comparison of dynamical systems is a challenging task in many fields. Bayesian approaches based on Gaussian process regression over time-series data have been successfully applied to infer the parameters of a…

Machine Learning · Statistics 2019-03-04 Philippe Wenk , Alkis Gotovos , Stefan Bauer , Nico Gorbach , Andreas Krause , Joachim M. Buhmann

Smoothness is a key inductive bias in machine learning and is closely related to generalization. Existing smoothness-inducing methods typically rely either on explicit gradient regularization, which often incurs substantial computational…

Machine Learning · Computer Science 2026-05-11 Parsa Moradi , Tayyebeh Jahaninezhad , Hanzaleh Akbarinodehi , Mohammad Ali Maddah-Ali

In this paper we develop and study adaptive empirical Bayesian smoothing splines. These are smoothing splines with both smoothing parameter and penalty order determined via the empirical Bayes method from the marginal likelihood of the…

Statistics Theory · Mathematics 2015-11-18 Paulo Serra , Tatyana Krivobokova

Ordinary differential equations (ODEs) are widely used to model biological, (bio-)chemical and technical processes. The parameters of these ODEs are often estimated from experimental data using ODE-constrained optimisation. This article…

Optimization and Control · Mathematics 2015-11-06 Anna Fiedler , Fabian J. Theis , Jan Hasenauer

Bayesian estimation is a vital tool in robotics as it allows systems to update the robot state belief using incomplete information from noisy sensors. To render the state estimation problem tractable, many systems assume that the motion and…

Robotics · Computer Science 2025-01-13 Miguel Saavedra-Ruiz , Steven A. Parkison , Ria Arora , James Richard Forbes , Liam Paull

In this work we develop an ordinary differential equations (ODE) model of physiological regulation of glycemia in type 1 diabetes mellitus (T1DM) patients in response to meals and intravenous insulin infusion. Unlike for the majority of…

We study empirical and hierarchical Bayes approaches to the problem of estimating an infinite-dimensional parameter in mildly ill-posed inverse problems. We consider a class of prior distributions indexed by a hyperparameter that quantifies…

Statistics Theory · Mathematics 2013-05-30 B. T. Knapik , B. T. Szabó , A. W. van der Vaart , J. H. van Zanten

Differential equations are frequently used in engineering domains, such as modeling and control of industrial systems, where safety and performance guarantees are of paramount importance. Traditional physics-based modeling approaches…

Systems and Control · Electrical Eng. & Systems 2020-11-30 Aaron Tuor , Jan Drgona , Draguna Vrabie

We develop a numerical method to reconstruct systems of ordinary differential equations (ODEs) from time series data without {\it a priori} knowledge of the underlying ODEs using sparse basis learning and sparse function reconstruction. We…

Data Analysis, Statistics and Probability · Physics 2016-05-19 Manuel Mai , Mark D. Shattuck , Corey S. O'Hern

This paper develops and implements a practical simulation-based method for estimating dynamic discrete choice models. The method, which can accommodate lagged dependent variables, serially correlated errors, unobserved variables, and many…

Statistics Theory · Mathematics 2015-07-23 Marianne Bruins , James A. Duffy , Michael P. Keane , Anthony A. Smith

Ordinary Differential Equations (ODEs) have recently gained a lot of attention in machine learning. However, the theoretical aspects, e.g., identifiability and asymptotic properties of statistical estimation are still obscure. This paper…

Machine Learning · Statistics 2024-06-04 Yuanyuan Wang , Wei Huang , Mingming Gong , Xi Geng , Tongliang Liu , Kun Zhang , Dacheng Tao

Recent advances have reformulated diffusion models as deterministic ordinary differential equations (ODEs) through the framework of flow matching, providing a unified formulation for the noise-to-data generative process. Various…

Computer Vision and Pattern Recognition · Computer Science 2026-02-11 Yan Luo , Henry Huang , Todd Y. Zhou , Mengyu Wang

Ordinary differential equations (ODEs) provide a powerful framework for modeling dynamic systems arising in a wide range of scientific domains. However, most existing ODE methods focus on a single system, and do not adequately address the…

Methodology · Statistics 2026-04-08 Shuoxun Xu , Zijian Guo , Brooke R. Staveland , Robert T. Knight , Lexin Li