English
Related papers

Related papers: Martingale product estimators for sensitivity anal…

200 papers

We consider a Markov jump process on a general state space to which we apply a time-dependent weak perturbation over a finite time interval. By martingale-based stochastic calculus, under a suitable exponential moment bound for the…

Probability · Mathematics 2024-05-14 Alessandra Faggionato , Vittoria Silvestri

This paper considers the problem of robust adaptive efficient estimating of a periodic function in a continuous time regression model with the dependent noises given by a general square integrable semimartingale with a conditionally…

Statistics Theory · Mathematics 2019-09-24 Evgeny Pchelintsev , Serguei Pergamenshchikov

In this paper we introduce the concept of conic martingales}. This class refers to stochastic processes having the martingale property, but that evolve within given (possibly time-dependent) boundaries. We first review some results about…

Probability · Mathematics 2016-03-25 Frédéric Vrins , Monique Jeanblanc

Marginal structural models were introduced in order to provide estimates of causal effects from interventions based on observational studies in epidemiological research. The key point is that this can be understood in terms of Girsanov's…

Statistics Theory · Mathematics 2011-07-15 Kjetil Røysland

In uncertainty quantification, a stochastic modelling is often applied, where parameters are substituted by random variables. We investigate linear dynamical systems of ordinary differential equations with a quantity of interest as output.…

Numerical Analysis · Mathematics 2019-09-23 Roland Pulch , Akil Narayan

Reinforcement learning methods for robotics are increasingly successful due to the constant development of better policy gradient techniques. A precise (low variance) and accurate (low bias) gradient estimator is crucial to face…

Machine Learning · Computer Science 2022-03-09 Joao Carvalho , Jan Peters

We study the impact of stochastic perturbations to deterministic dynamical systems using the formalism of the Ruelle response theory and explore how stochastic noise can be used to explore the properties of the underlying deterministic…

Statistical Mechanics · Physics 2015-05-27 Valerio Lucarini

We consider the problem of approximating the product of $n$ expectations with respect to a common probability distribution $\mu$. Such products routinely arise in statistics as values of the likelihood in latent variable models. Motivated…

Computation · Statistics 2017-09-05 Anthony Lee , Simone Tiberi , Giacomo Zanella

This paper provides the time-dependent $L^2$-martingale representation of the forward stochastic integral where the driving noise is the Riemann-Liouville fractional Brownian motion with parameter $\frac{1}{2} < H < 1$ and the integrand is…

Probability · Mathematics 2025-12-16 Paulo Henrique da Costa , Alberto Ohashi , Francesco Russo

In this paper we study Monte Carlo estimators based on the likelihood ratio approach for steady-state sensitivity. We first extend the result of Glynn and Olvera-Cravioto [doi:doi: 10.1287/stsy.2018.002] to the setting of continuous time…

Probability · Mathematics 2019-01-23 Ting Wang , Petr Plechac

In stochastic quantisation, quantum mechanical expectation values are computed as averages over the time history of a stochastic process described by a Langevin equation. Complex stochastic quantisation, though theoretically not rigorously…

High Energy Physics - Lattice · Physics 2014-08-18 Amel Durakovic , Emil Cortes Andre , Anders Tranberg

We propose a new sensitivity analysis methodology for complex stochastic dynamics based on the Relative Entropy Rate. The method becomes computationally feasible at the stationary regime of the process and involves the calculation of…

Mathematical Physics · Physics 2013-04-16 Yannis Pantazis , Markos A. Katsoulakis

In applications of Gaussian processes where quantification of uncertainty is of primary interest, it is necessary to accurately characterize the posterior distribution over covariance parameters. This paper proposes an adaptation of the…

Methodology · Statistics 2015-09-04 Maurizio Filippone , Raphael Engler

In this paper, we consider a class of stochastic optimal control problems with risk constraints that are expressed as bounded probabilities of failure for particular initial states. We present here a martingale approach that diffuses a risk…

Systems and Control · Computer Science 2015-07-09 Vu Anh Huynh , Leonid Kogan , Emilio Frazzoli

By decoupling forward and backward stochastic trajectories, we construct a family of martingales and work theorems for both overdamped and underdamped Langevin dynamics. Our results are made possible by an alternative derivation of work…

Statistical Mechanics · Physics 2025-04-17 Xiangting Li , Tom Chou

We present a theoretical framework for M-FISHER, a method for sequential distribution shift detection and stable adaptation in streaming data. For detection, we construct an exponential martingale from non-conformity scores and apply…

Machine Learning · Computer Science 2025-10-07 Behraj Khan , Tahir Qasim Syed

Reinforcement learning methods for robotics are increasingly successful due to the constant development of better policy gradient techniques. A precise (low variance) and accurate (low bias) gradient estimator is crucial to face…

Machine Learning · Computer Science 2021-07-21 João Carvalho , Davide Tateo , Fabio Muratore , Jan Peters

We consider a class of stochastic control problems where the state process is a probability measure-valued process satisfying an additional martingale condition on its dynamics, called measure-valued martingales (MVMs). We establish the…

Probability · Mathematics 2023-08-29 Alexander M. G. Cox , Sigrid Källblad , Martin Larsson , Sara Svaluto-Ferro

For a Markovian dynamics on discrete states, the logarithmic ratio of waiting-time distributions between two successive, instantaneous transitions in forward and backward direction is a measure of time-irreversibility. It thus serves as an…

Statistical Mechanics · Physics 2024-06-13 Ellen Meyberg , Julius Degünther , Udo Seifert

This paper deals with the problem of estimating second-order parameter sensitivities for stochastic reaction networks, where the reaction dynamics is modeled as a continuous time Markov chain over a discrete state space. Estimation of such…

Probability · Mathematics 2014-07-29 Ankit Gupta , Mustafa Khammash