English
Related papers

Related papers: Bayesian Smooth-and-Match strategy for ordinary di…

200 papers

In this work we study orbit recovery over $SO(3)$, where the goal is to recover a function on the sphere from noisy, randomly rotated copies of it. We assume that the function is a linear combination of low-degree spherical harmonics. This…

Data Structures and Algorithms · Computer Science 2022-05-03 Allen Liu , Ankur Moitra

We detail a novel class of implicit neural models. Leveraging time-parallel methods for differential equations, Multiple Shooting Layers (MSLs) seek solutions of initial value problems via parallelizable root-finding algorithms. MSLs…

Machine Learning · Computer Science 2021-06-09 Stefano Massaroli , Michael Poli , Sho Sonoda , Taji Suzuki , Jinkyoo Park , Atsushi Yamashita , Hajime Asama

We consider the problem of computing the satisfaction probability of a formula for stochastic models with parametric uncertainty. We show that this satisfaction probability is a smooth function of the model parameters. This enables us to…

Logic in Computer Science · Computer Science 2014-10-23 Luca Bortolussi , Dimitrios Milios , Guido Sanguinetti

Despite the advancements in learning governing differential equations from observations of dynamical systems, data-driven methods are often unaware of fundamental physical laws, such as frame invariance. As a result, these algorithms may…

Machine Learning · Computer Science 2024-11-06 Jianke Yang , Wang Rao , Nima Dehmamy , Robin Walters , Rose Yu

Parameter inference is a fundamental problem in data-driven modeling. Given observed data that is believed to be a realization of some parameterized model, the aim is to find parameter values that are able to explain the observed data. In…

Data Structures and Algorithms · Computer Science 2016-04-20 Carlo Albert , Simone Ulzega , Ruedi Stoop

Unnormalized (or energy-based) models provide a flexible framework for capturing the characteristics of data with complex dependency structures. However, the application of standard Bayesian inference methods has been severely limited…

Methodology · Statistics 2026-03-11 Naruki Sonobe , Shonosuke Sugasawa , Daichi Mochihashi , Takeru Matsuda

There are proposals that extend the classical generalized additive models (GAMs) to accommodate high-dimensional data ($p>>n$) using group sparse regularization. However, the sparse regularization may induce excess shrinkage when estimating…

Methodology · Statistics 2022-07-07 Boyi Guo , Byron C. Jaeger , A. K. M. Fazlur Rahman , D. Leann Long , Nengjun Yi

Machine Learning models incorporating multiple layered learning networks have been seen to provide effective models for various classification problems. The resulting optimization problem to solve for the optimal vector minimizing the…

Optimization and Control · Mathematics 2018-07-03 Vyacheslav Kungurtsev , Tomas Pevny

Often the regression function is specified by a system of ordinary differential equations (ODEs) involving some unknown parameters. Typically analytical solution of the ODEs is not available, and hence likelihood evaluation at many…

Statistics Theory · Mathematics 2016-02-23 Prithwish Bhaumik , Subhashis Ghosal

We propose a machine learning framework to accelerate numerical computations of time-dependent ODEs and PDEs. Our method is based on recasting (generalizations of) existing numerical methods as artificial neural networks, with a set of…

Numerical Analysis · Mathematics 2019-03-08 Siddhartha Mishra

Automatic machine learning of empirical models from experimental data has recently become possible as a result of increased availability of computational power and dedicated algorithms. Despite the successes of non-parametric inference and…

Statistical Mechanics · Physics 2024-06-04 Yunfei Huang , Youssef Mabrouk , Gerhard Gompper , Benedikt Sabass

We consider parameter estimation of ordinary differential equation (ODE) models from noisy observations. For this problem, one conventional approach is to fit numerical solutions (e.g., Euler, Runge--Kutta) of ODEs to data. However, such a…

Methodology · Statistics 2021-09-01 Takeru Matsuda , Yuto Miyatake

In this paper we address smoothing-that is, optimisation-based-estimation techniques for localisation problems in the case where motion sensors are very accurate. Our mathematical analysis focuses on the difficult limit case where motion…

Systems and Control · Electrical Eng. & Systems 2022-04-12 Paul Chauchat , Silvere Bonnabel , Axel Barrau

Bayesian optimization is a sequential method for minimizing objective functions that are expensive to evaluate and about which few assumptions can be made. By using all gathered data to train a Gaussian process model for the function and…

Machine Learning · Computer Science 2026-05-07 Jesse Schneider , William J. Welch

We introduce a provably stable variant of neural ordinary differential equations (neural ODEs) whose trajectories evolve on an energy functional parametrised by a neural network. Stable neural flows provide an implicit guarantee on…

Machine Learning · Computer Science 2020-03-19 Stefano Massaroli , Michael Poli , Michelangelo Bin , Jinkyoo Park , Atsushi Yamashita , Hajime Asama

Training Neural Ordinary Differential Equations (ODEs) is often computationally expensive. Indeed, computing the forward pass of such models involves solving an ODE which can become arbitrarily complex during training. Recent works have…

Machine Learning · Computer Science 2020-11-03 Arnab Ghosh , Harkirat Singh Behl , Emilien Dupont , Philip H. S. Torr , Vinay Namboodiri

Due to spatial dependence -- often characterized as complex and non-linear -- model misspecification is a prevalent and critical issue in spatial data analysis and prediction. As the data, and thus model performance, is heterogeneous,…

Time-delayed differential equations (TDDEs) are widely used to model complex dynamic systems where future states depend on past states with a delay. However, inferring the underlying TDDEs from observed data remains a challenging problem…

Machine Learning · Statistics 2025-01-07 Debangshu Chowdhury , Souvik Chakraborty

Dynamical systems modeling, particularly via systems of ordinary differential equations, has been used to effectively capture the temporal behavior of different biochemical components in signal transduction networks. Despite the recent…

Quantitative Methods · Quantitative Biology 2023-01-06 Nathaniel J. Linden , Boris Kramer , Padmini Rangamani

By interpreting the forward dynamics of the latent representation of neural networks as an ordinary differential equation, Neural Ordinary Differential Equation (Neural ODE) emerged as an effective framework for modeling a system dynamics…

Machine Learning · Computer Science 2020-10-19 Daehoon Gwak , Gyuhyeon Sim , Michael Poli , Stefano Massaroli , Jaegul Choo , Edward Choi
‹ Prev 1 8 9 10 Next ›