English
Related papers

Related papers: Variance-reduced multiscale simulation of slow-fas…

200 papers

The stochastic simulation algorithm (SSA) and the corresponding Monte Carlo (MC) method are among the most common approaches for studying stochastic processes. They rely on knowledge of interevent probability density functions (PDFs) and on…

Computation · Statistics 2024-02-12 S. Rusconi , E. Akhmatskaya , D. Sokolovski , N. Ballard , J. C. de la Cal

We discuss the issue of estimating large-scale vector autoregressive (VAR) models with stochastic volatility in real-time situations where data are sampled at different frequencies. In the case of a large VAR with stochastic volatility, the…

Econometrics · Economics 2019-12-06 Sebastian Ankargren , Paulina Jonéus

Variational inference approximates the posterior distribution of a probabilistic model with a parameterized density by maximizing a lower bound for the model evidence. Modern solutions fit a flexible approximation with stochastic gradient…

Machine Learning · Statistics 2017-07-13 Joseph Sakaya , Arto Klami

In this paper we present an enhancement of the regression-based variance reduction approaches recently proposed in Belomestny et al. This enhancement is based on a truncation of the control variate and allows for a significant reduction of…

Probability · Mathematics 2017-11-10 Denis Belomestny , Stefan Häfner , Mikhail Urusov

Macroscopic dynamical descriptions of complex physical systems are crucial for understanding and controlling material behavior. With the growing availability of data and compute, machine learning has become a promising alternative to…

Computational Physics · Physics 2026-03-24 Mengyi Chen , Pengru Huang , Kostya S. Novoselov , Qianxiao Li

We introduce and study a variational framework for the analysis of empirical risk based inference for dynamical systems and ergodic processes. The analysis applies to a two-stage estimation procedure in which (i) the trajectory of an…

Dynamical Systems · Mathematics 2018-01-24 Kevin McGoff , Andrew B. Nobel

Approximate inference in complex probabilistic models such as deep Gaussian processes requires the optimisation of doubly stochastic objective functions. These objectives incorporate randomness both from mini-batch subsampling of the data…

Machine Learning · Statistics 2020-03-26 Ayman Boustati , Sattar Vakili , James Hensman , ST John

We demonstrate the use of a variational method to determine a quantitative lower bound on the rate of convergence of Markov Chain Monte Carlo (MCMC) algorithms as a function of the target density and proposal density. The bound relies on…

Data Analysis, Statistics and Probability · Physics 2013-05-29 Fergal P. Casey , Joshua J. Waterfall , Ryan N. Gutenkunst , Christopher R. Myers , James P. Sethna

Stochastic optimization techniques are standard in variational inference algorithms. These methods estimate gradients by approximating expectations with independent Monte Carlo samples. In this paper, we explore a technique that uses…

Machine Learning · Computer Science 2019-08-15 Mike Wu , Noah Goodman , Stefano Ermon

We introduce a temporal scheme for data sampling, based on a variable delay between two successive data acquisitions. The scheme is designed so as to reduce the average data flow rate, while still retaining the information on the data…

Soft Condensed Matter · Physics 2016-08-06 A. Philippe , S. Aime , V. Roger , R. Jelinek , G. Prévot , L. Berthier , L. Cipelletti

This paper studies the dynamic programming principle using the measurable selection method for stochastic control of continuous processes. The novelty of this work is to incorporate intermediate expectation constraints on the canonical…

Optimization and Control · Mathematics 2020-04-22 Yuk-Loong Chow , Xiang Yu , Chao Zhou

We introduce a nonlinear stochastic model reduction technique for high-dimensional stochastic dynamical systems that have a low-dimensional invariant effective manifold with slow dynamics, and high-dimensional, large fast modes. Given only…

Machine Learning · Statistics 2023-10-25 Felix X. -F. Ye , Sichen Yang , Mauro Maggioni

Markov chain Monte Carlo is a method of producing a correlated sample in order to estimate features of a target distribution via ergodic averages. A fundamental question is when should sampling stop? That is, when are the ergodic averages…

Statistics Theory · Mathematics 2007-06-13 Galin Jones , Murali Haran , Brian Caffo , Ronald Neath

We present and analyse a micro-macro acceleration method for the Monte Carlo simulation of stochastic differential equations with separation between the (fast) time-scale of individual trajectories and the (slow) time-scale of the…

Numerical Analysis · Mathematics 2017-12-04 Kristian Debrabant , Giovanni Samaey , Przemysław Zieliński

In Markov Chain Monte Carlo (MCMC) simulations, the thermal equilibria quantities are estimated by ensemble average over a sample set containing a large number of correlated samples. These samples are selected in accordance with the…

Data Analysis, Statistics and Probability · Physics 2015-01-08 J. Li , P. Vignal , S. Sun , V. M. Calo

A key issue in dimension reduction of dissipative dynamical systems with spectral gaps is the identification of slow invariant manifolds. We present theoretical and numerical results for a variational approach to the problem of computing…

Dynamical Systems · Mathematics 2012-11-30 Dirk Lebiedz , Jochen Siehr , Jonas Unger

The computation of free energies is a common issue in statistical physics. A natural technique to compute such high dimensional integrals is to resort to Monte Carlo simulations. However these techniques generally suffer from a high…

Statistical Mechanics · Physics 2021-05-17 Grégoire Ferré , Tobias Grafke

In uncertainty quantification, a stochastic modelling is often applied, where parameters are substituted by random variables. We investigate linear dynamical systems of ordinary differential equations with a quantity of interest as output.…

Numerical Analysis · Mathematics 2019-09-23 Roland Pulch , Akil Narayan

We implement a computer-assisted approach that, under appropriate conditions, allows the bifurcation analysis of the coarse dynamic behavior of microscopic simulators without requiring the explicit derivation of closed macroscopic equations…

Pattern Formation and Solitons · Physics 2009-11-07 Alexei G. Makeev , Dimitrios Maroudas , Ioannis G. Kevrekidis

This paper develops a variational inference framework for control of infinite dimensional stochastic systems. We employ a measure theoretic approach which relies on the generalization of Girsanov's theorem, as well as the relation between…

Optimization and Control · Mathematics 2018-09-11 George I. Boutselis , Marcus Pereira , Evangelos A. Theodorou