English
Related papers

Related papers: Forward sensitivity analysis for contracting stoch…

200 papers

Stochastic-gradient sampling methods are often used to perform Bayesian inference on neural networks. It has been observed that the methods in which notions of differential geometry are included tend to have better performances, with the…

Machine Learning · Computer Science 2024-04-02 Hanlin Yu , Marcelo Hartmann , Bernardo Williams , Arto Klami

Optimal transport is a foundational problem in optimization, that allows to compare probability distributions while taking into account geometric aspects. Its optimal objective value, the Wasserstein distance, provides an important loss…

Machine Learning · Computer Science 2020-02-21 Marin Ballu , Quentin Berthet , Francis Bach

This paper focuses on the contextual optimization problem where a decision is subject to some uncertain parameters and covariates that have some predictive power on those parameters are available before the decision is made. More…

Optimization and Control · Mathematics 2024-08-12 Zhaoen Li , Maoqi Liu , Zhi-Hai Zhang

We perform scalable approximate inference in continuous-depth Bayesian neural networks. In this model class, uncertainty about separate weights in each layer gives hidden units that follow a stochastic differential equation. We demonstrate…

Machine Learning · Statistics 2022-02-01 Winnie Xu , Ricky T. Q. Chen , Xuechen Li , David Duvenaud

We consider time series data modeled by ordinary differential equations (ODEs), widespread models in physics, chemistry, biology and science in general. The sensitivity analysis of such dynamical systems usually requires calculation of…

Methodology · Statistics 2017-09-20 Valdemar Melicher , Tom Haber , Wim Vanroose

We present an adjoint sensitivity method for hybrid discrete -- continuous systems, extending previously published forward sensitivity methods. We treat ordinary differential equations and differential-algebraic equations of index up to two…

Optimization and Control · Mathematics 2019-04-19 Radu Serban , Antonio Recuero

In this paper, we consider the convergence rate with respect to the Wasserstein distance in the invariance principle for sequential dynamical systems. We utilize and modify the techniques previously employed for stationary sequences to…

Dynamical Systems · Mathematics 2024-10-29 Zhenxin Liu , Zhe Wang

We study the contraction in Wasserstein distance of the coordinate ascent variational inference algorithm. This is shown to hold under a transport-information inequality at the fixed points and a functional smoothness condition. The results…

Machine Learning · Statistics 2026-05-29 Rocco Caprio , Adrien Corenflos , Sam Power

The convergence to the stationary regime is studied for Stochastic Differential Equations driven by an additive Gaussian noise and evolving in a semi-contractive environment, i.e. when the drift is only contractive out of a compact set but…

Probability · Mathematics 2020-06-04 Fabien Panloup , Alexandre Richard

Stochastic kinetic models describe systems across biology, chemistry, and physics where discrete events and small populations render deterministic approximations inadequate. Parameter inference and inverse design in these systems require…

Computational Physics · Physics 2026-03-06 Francesco Mottes , Qian-Ze Zhu , Michael P. Brenner

This study proposes a novel approach to ensemble prediction, called "covariate-dependent stacking" (CDST). Unlike traditional stacking and model averaging methods, CDST allows model weights to vary flexibly as a function of covariates,…

Methodology · Statistics 2025-09-29 Tomoya Wakayama , Shonosuke Sugasawa

Distinguishing quantum states with minimal sampling overhead is of fundamental importance to teach quantum data to an algorithm. Recently, the quantum Wasserstein distance emerged from the theory of quantum optimal transport as a promising…

Quantum Physics · Physics 2025-12-02 Gonzalo Camacho , Benedikt Fauseweh

To deal with stochastic hybrid systems with general state-dependent switching, we propose an approximation method by a sequence of stochastic hybrid systems with piecewise constant type switching. The convergence rate in the Wasserstein…

Probability · Mathematics 2023-05-17 Jinghai Shao , Lingdi Wang , Qiong Wu

We introduce a version of Stein's method of comparison of operators specifically tailored to the problem of bounding the Wasserstein-1 distance between continuous and discrete distributions on the real line. Our approach rests on a new…

Probability · Mathematics 2023-11-03 Gilles Germain , Yvik Swan

Complex systems are characterized by a huge number of degrees of freedom often interacting in a non-linear manner. In many cases macroscopic states, however, can be characterized by a small number of order parameters that obey stochastic…

Data Analysis, Statistics and Probability · Physics 2012-02-20 David Kleinhans

The evolution of any complex dynamical system is described by its state derivative operators. However, the extraction of the exact N-order state derivative operators is often inaccurate and requires approximations. The open-source CFD code…

Fluid Dynamics · Physics 2022-10-26 Arthur Poulain , Cedric Content , Denis Sipp , Georgios Rigas , Eric Garnier

We propose an online parametric estimation method of stochastic differential equations with discrete observations and misspecified modelling based on online gradient descent. Our study provides uniform upper bounds for the risks of the…

Statistics Theory · Mathematics 2022-10-18 Shogo Nakakita

In a variety of problems originating in supervised, unsupervised, and reinforcement learning, the loss function is defined by an expectation over a collection of random variables, which might be part of a probabilistic model or the external…

Machine Learning · Computer Science 2016-01-06 John Schulman , Nicolas Heess , Theophane Weber , Pieter Abbeel

Discretizations of Langevin diffusions provide a powerful method for sampling and Bayesian inference. However, such discretizations require evaluation of the gradient of the potential function. In several real-world scenarios, obtaining…

Statistics Theory · Mathematics 2021-01-19 Abhishek Roy , Lingqing Shen , Krishnakumar Balasubramanian , Saeed Ghadimi

Reservoir computing systems are constructed using a driven dynamical system in which external inputs can alter the evolving states of a system. These paradigms are used in information processing, machine learning, and computation. A…

Neural and Evolutionary Computing · Computer Science 2023-04-26 G Manjunath , Juan-Pablo Ortega