English
Related papers

Related papers: Forward sensitivity analysis for contracting stoch…

200 papers

We address the problem of estimating steady-state quantities associated to systems of stochastic chemical kinetics. In most cases of interest these systems are analytically intractable, and one has to resort to computational methods to…

Quantitative Methods · Quantitative Biology 2014-01-21 Andreas Milias-Argeitis , John Lygeros , Mustafa Khammash

This paper is motivated by the problem of quantitatively bounding the convergence of adaptive control methods for stochastic systems to a stationary distribution. Such bounds are useful for analyzing statistics of trajectories and…

Optimization and Control · Mathematics 2021-10-19 Tyler Lekang , Andrew Lamperski

We present a previously unexplored forward-mode differentiation method for Maxwell's equations, with applications in the field of sensitivity analysis. This approach yields exact gradients and is similar to the popular adjoint variable…

Optics · Physics 2019-12-24 Tyler W Hughes , Ian A D Williamson , Momchil Minkov , Shanhui Fan

The adjoint sensitivity method scalably computes gradients of solutions to ordinary differential equations. We generalize this method to stochastic differential equations, allowing time-efficient and constant-memory computation of gradients…

Machine Learning · Computer Science 2020-10-20 Xuechen Li , Ting-Kam Leonard Wong , Ricky T. Q. Chen , David Duvenaud

We investigate the problem of pricing derivatives under a fractional stochastic volatility model. We obtain an approximate expression of the derivative price where the stochastic volatility can be composed of deterministic functions of time…

Pricing of Securities · Quantitative Finance 2022-10-28 Yuecai Han , Xudong Zheng

Wasserstein gradient flows are continuous time dynamics that define curves of steepest descent to minimize an objective function over the space of probability measures (i.e., the Wasserstein space). This objective is typically a divergence…

Optimization and Control · Mathematics 2021-02-23 Adil Salim , Anna Korba , Giulia Luise

Stochastic Gradient Descent (SGD) is an important algorithm in machine learning. With constant learning rates, it is a stochastic process that, after an initial phase of convergence, generates samples from a stationary distribution. We show…

Machine Learning · Statistics 2017-09-12 Stephan Mandt , Matthew D. Hoffman , David M. Blei

Gaussian processes are a powerful framework for quantifying uncertainty and for sequential decision-making but are limited by the requirement of solving linear systems. In general, this has a cubic cost in dataset size and is sensitive to…

Calibration of large-scale differential equation models to observational or experimental data is a widespread challenge throughout applied sciences and engineering. A crucial bottleneck in state-of-the art calibration methods is the…

Optimization and Control · Mathematics 2021-02-23 Jon Cockayne , Andrew B. Duncan

This paper addresses the design and analysis of a multivariable gradient-based stochastic extremum-seeking control method for multi-input systems with arbitrary input delays. The approach accommodates systems with distinct time delays…

Optimization and Control · Mathematics 2024-11-19 Paulo Cesar Souza Silva , Paulo Cesar Pellanda , Tiago Roux Oliveira

Predictive states for stochastic processes are a nonparametric and interpretable construct with relevance across a multitude of modeling paradigms. Recent progress on the self-supervised reconstruction of predictive states from time-series…

Statistical Mechanics · Physics 2022-12-21 Samuel P. Loomis , James P. Crutchfield

This paper investigates the problem of tracking solutions of stochastic optimization problems with time-varying costs that depend on random variables with decision-dependent distributions. In this context, we propose the use of an online…

Optimization and Control · Mathematics 2021-10-29 Killian Wood , Gianluca Bianchin , Emiliano Dall'Anese

In order to bring contraction analysis into the very fruitful and topical fields of stochastic and Bayesian systems, we extend here the theory describes in \cite{Lohmiller98} to random differential equations. We propose new definitions of…

Optimization and Control · Mathematics 2013-09-27 Nicolas Tabareau , Jean-Jacques Slotine

We consider a general online stochastic optimization problem with multiple budget constraints over a horizon of finite time periods. In each time period, a reward function and multiple cost functions are revealed, and the decision maker…

Machine Learning · Computer Science 2022-07-26 Jiashuo Jiang , Xiaocheng Li , Jiawei Zhang

Variational inference, such as the mean-field (MF) approximation, requires certain conjugacy structures for efficient computation. These can impose unnecessary restrictions on the viable prior distribution family and further constraints on…

Statistics Theory · Mathematics 2023-09-11 Rentian Yao , Yun Yang

Gradients can be employed for sensitivity analysis. Here, we leverage the advantages of the Loss Landscape to comprehend which independent variables impact the dependent variable. We seek to grasp the loss landscape by utilizing first,…

Machine Learning · Computer Science 2024-03-06 Salman Faroz

Due to their conjugate posteriors, Gaussian process priors are attractive for estimating the drift of stochastic differential equations with continuous time observations. However, their performance strongly depends on the choice of the…

Statistics Theory · Mathematics 2020-02-04 Jan van Waaij

How can we perform efficient inference and learning in directed probabilistic models, in the presence of continuous latent variables with intractable posterior distributions, and large datasets? We introduce a stochastic variational…

Machine Learning · Statistics 2022-12-13 Diederik P Kingma , Max Welling

In this paper, an attack-resilient estimation algorithm is presented for linear discrete-time stochastic systems with state and input constraints. It is shown that the state estimation errors of the proposed estimation algorithm are…

Optimization and Control · Mathematics 2019-03-21 Wenbin Wan , Hunmin Kim , Naira Hovakimyan , Petros G. Voulgaris

We analyze the effect of small changes in the underlying probabilistic model on the value of multi-period stochastic optimization problems and optimal stopping problems. We work in finite discrete time and measure these changes with the…

Optimization and Control · Mathematics 2023-06-19 Daniel Bartl , Johannes Wiesel