English
Related papers

Related papers: Variational Walkback: Learning a Transition Operat…

200 papers

In this work, we investigate a novel training procedure to learn a generative model as the transition operator of a Markov chain, such that, when applied repeatedly on an unstructured random noise sample, it will denoise it into a sample…

Machine Learning · Statistics 2017-03-22 Florian Bordes , Sina Honari , Pascal Vincent

Optimal designs minimize the number of experimental runs (samples) needed to accurately estimate model parameters, resulting in algorithms that, for instance, efficiently minimize parameter estimate variance. Governed by knowledge of past…

Methodology · Statistics 2023-02-03 Nicholas W. Barendregt , Emily G. Webb , Zachary P. Kilpatrick

We consider the problem of estimating the asymptotic variance of a function defined on a Markov chain, an important step for statistical inference of the stationary mean. We design a novel recursive estimator that requires $O(1)$…

Statistics Theory · Mathematics 2024-09-24 Shubhada Agrawal , Prashanth L. A. , Siva Theja Maguluri

Due to the intractable partition function, training energy-based models (EBMs) by maximum likelihood requires Markov chain Monte Carlo (MCMC) sampling to approximate the gradient of the Kullback-Leibler divergence between data and model…

Machine Learning · Statistics 2021-12-28 Jianwen Xie , Zilong Zheng , Ping Li

Markov jump processes are continuous-time stochastic processes with a wide range of applications in both natural and social sciences. Despite their widespread use, inference in these models is highly non-trivial and typically proceeds via…

Machine Learning · Computer Science 2023-06-01 Patrick Seifner , Ramses J. Sanchez

We develop an approach to training generative models based on unrolling a variational auto-encoder into a Markov chain, and shaping the chain's trajectories using a technique inspired by recent work in Approximate Bayesian computation. We…

Machine Learning · Computer Science 2017-08-03 Philip Bachman , Doina Precup

Iterative load balancing algorithms for indivisible tokens have been studied intensively in the past. Complementing previous worst-case analyses, we study an average-case scenario where the load inputs are drawn from a fixed probability…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-03-28 Leran Cai , Thomas Sauerwald

Existing studies on the degree correlation of evolving networks typically rely on differential equations and statistical analysis, resulting in only approximate solutions due to inherent randomness. To address this limitation, we propose an…

Computation · Statistics 2024-06-13 Yue Xiao , Xiaojun Zhang

Stochastic processes generated by non-stationary distributions are difficult to represent with conventional models such as Gaussian processes. This work presents Recurrent Autoregressive Flows as a method toward general stochastic process…

Machine Learning · Computer Science 2020-06-20 John Mern , Peter Morales , Mykel J. Kochenderfer

We introduce the task of action-driven stochastic human motion prediction, which aims to predict multiple plausible future motions given a sequence of action labels and a short motion history. This differs from existing works, which predict…

Computer Vision and Pattern Recognition · Computer Science 2022-06-01 Wei Mao , Miaomiao Liu , Mathieu Salzmann

In this paper, we present a numerical framework for constructing bounds on stationary performance measures of random walks in the positive orthant using the Markov reward approach. These bounds are established in terms of stationary…

Probability · Mathematics 2018-11-22 Xinwei Bai , Jasper Goseling

We present a case study applying learning-based distributionally robust model predictive control to highway motion planning under stochastic uncertainty of the lane change behavior of surrounding road users. The dynamics of road users are…

Systems and Control · Electrical Eng. & Systems 2022-11-08 Mathijs Schuurmans , Alexander Katriniok , Christopher Meissen , H. Eric Tseng , Panagiotis Patrinos

Reaction networks are widely used models to describe biochemical processes. Stochastic fluctuations in the counts of biological macromolecules have amplified consequences due to their small population sizes. This makes it necessary to favor…

Probability · Mathematics 2022-02-28 Daniele Cappelletti , Badal Joshi

In this work, we focus on the stationary analysis of a specific class of continuous time Markov-modulated reflected random walks in the quarter plane with applications in the modelling of two-node Markov-modulated queueing networks with…

Probability · Mathematics 2020-06-02 Ioannis Dimitriou

The methodology based on the random walk processes is adapted and applied to a comprehensive analysis of the statistical properties of the probability fluxes. To this aim we define a simple model of the Markovian stochastic dynamics on a…

Statistical Mechanics · Physics 2015-12-15 Przemyslaw Chelminiak , Michal Kurzynski

In this paper we study the dynamics of nonlinear random walks. While typical random walks on networks consist of standard Markov chains whose static transition probabilities dictate the flow of random walkers through the network, nonlinear…

Pattern Formation and Solitons · Physics 2019-02-25 Per Sebastian Skardal , Sabina Adhikari

Parameter sensitivity analysis is a powerful tool in the building and analysis of biochemical network models. For stochastic simulations, parameter sensitivity analysis can be computationally expensive, requiring multiple simulations for…

Computational Physics · Physics 2015-06-04 Patrick B. Warren , Rosalind J. Allen

A discrete-time Markov chain can be transformed into a new Markov chain by looking at its states along iterations of an almost surely finite stopping time. By the optional stopping theorem, any bounded harmonic function with respect to the…

Probability · Mathematics 2022-05-04 Iddo Ben-Ari , Behrang Forghani

Generative Stochastic Networks (GSNs) have been recently introduced as an alternative to traditional probabilistic modeling: instead of parametrizing the data distribution directly, one parametrizes a transition operator for a Markov chain…

Machine Learning · Computer Science 2014-09-04 Sherjil Ozair , Li Yao , Yoshua Bengio

We study the problem of learning the Markov order in categorical sequences that represent paths in a network, i.e. sequences of variable lengths where transitions between states are constrained to a known graph. Such data pose challenges…

Machine Learning · Computer Science 2020-07-07 Luka V. Petrović , Ingo Scholtes