English
Related papers

Related papers: Maximum Likelihood Estimation for Stochastic Diffe…

200 papers

This paper introduces a new approach to generating sample paths of unknown Markovian stochastic differential equations (SDEs) using diffusion models, a class of generative AI methods commonly employed in image and video applications. Unlike…

Machine Learning · Computer Science 2026-03-17 Xuefeng Gao , Jiale Zha , Xun Yu Zhou

We consider the problem of inferring a latent function in a probabilistic model of data. When dependencies of the latent function are specified by a Gaussian process and the data likelihood is complex, efficient computation often involve…

Machine Learning · Statistics 2018-07-23 Martin Tegner , Benjamin Bloem-Reddy , Stephen Roberts

We describe an embarrassingly parallel, anytime Monte Carlo method for likelihood-free models. The algorithm starts with the view that the stochasticity of the pseudo-samples generated by the simulator can be controlled externally by a…

Machine Learning · Computer Science 2015-12-03 Edward Meeds , Max Welling

In this paper we consider Bayesian parameter inference associated to a class of partially observed stochastic differential equations (SDE) driven by jump processes. Such type of models can be routinely found in applications, of which we…

Neurons and Cognition · Quantitative Biology 2024-12-03 Mohamed Maama , Ajay Jasra , Kengo Kamatani

In this paper, we propose two new algorithms for maximum-likelihood estimation (MLE) of high dimensional sparse covariance matrices. Unlike most of the state of-the-art methods, which either use regularization techniques or penalize the…

Methodology · Statistics 2023-05-12 Ghania Fatima , Prabhu Babu , Petre Stoica

Sequential Monte Carlo methods which involve sequential importance sampling and resampling are shown to provide a versatile approach to computing probabilities of rare events. By making use of martingale representations of the sequential…

Probability · Mathematics 2012-02-22 Hock Peng Chan , Tze Leung Lai

Parameter inference for stochastic differential equation mixed effects models (SDEMEMs) is a challenging problem. Analytical solutions for these models are rarely available, which means that the likelihood is also intractable. In this case,…

Computation · Statistics 2019-09-30 Imke Botha , Robert Kohn , Christopher Drovandi

We consider the problem of estimating expectations with respect to a target distribution with an unknown normalizing constant, and where even the unnormalized target needs to be approximated at finite resolution. Under such an assumption,…

Numerical Analysis · Mathematics 2023-06-29 Xinzhu Liang , Shangda Yang , Simon L. Cotter , Kody J. H. Law

We present both offline and online maximum likelihood estimation (MLE) techniques for inferring the static parameters of a multiple target tracking (MTT) model with linear Gaussian dynamics. We present the batch and online versions of the…

Applications · Statistics 2014-10-09 Sinan Yildirim , Lan Jiang , Sumeetpal S. Singh , Tom Dean

The expectation-maximization (EM) algorithm is a powerful computational technique for finding the maximum likelihood estimates for parametric models when the data are not fully observed. The EM is best suited for situations where the…

Computation · Statistics 2018-05-14 Chanseok Park

We consider the probabilistic numerical scheme for fully nonlinear PDEs suggested in \cite{cstv}, and show that it can be introduced naturally as a combination of Monte Carlo and finite differences scheme without appealing to the theory of…

Probability · Mathematics 2010-08-26 Arash Fahim , Nizar Touzi , Xavier Warin

It is proposed in the literature that in some complicated problems maximum likelihood estimates (MLE) are not suitable or even do not exist. An alternative to MLE for estimation of the parameters is the Bayesian method. The Markov chain…

Applications · Statistics 2019-10-08 Ali Reza Fotouhi

In this paper, an alternative Discrete skew Logistic distribution is proposed, which is derived by using the general approach of discretizing a continuous distribution while retaining its survival function. The properties of the…

Methodology · Statistics 2016-04-07 Deepesh Bhati , Subrata Chakraborty , Snober Gowhar Lateef

Models for which the likelihood function can be evaluated only up to a parameter-dependent unknown normalising constant, such as Markov random field models, are used widely in computer science, statistical physics, spatial statistics, and…

Computation · Statistics 2016-02-12 Richard G. Everitt , Adam M. Johansen , Ellen Rowing , Melina Evdemon-Hogan

Probabilistic programs with mixed support (both continuous and discrete latent random variables) commonly appear in many probabilistic programming systems (PPSs). However, the existence of the discrete random variables prohibits many basic…

Machine Learning · Computer Science 2020-03-06 David Tolpin , Yuan Zhou , Hongseok Yang

In this paper, we introduce a new method called SPSC (Simulation, Partitioning, Selection, Cloning) to estimate efficiently the probability of possible solutions in stochastic simulations. This method can be applied to any type of…

Multiagent Systems · Computer Science 2019-09-23 Yu-Lin Huang , Gildas Morvan , Frédéric Pichon , David Mercier

We consider the problem of estimating expectations with respect to a target distribution with an unknown normalizing constant, and where even the unnormalized target needs to be approximated at finite resolution. This setting is ubiquitous…

Numerical Analysis · Mathematics 2023-03-23 Kody J. H. Law , Neil Walton , Shangda Yang , Ajay Jasra

This paper introduces methodology for performing Bayesian inference sequentially on a sequence of posteriors on spaces of different dimensions. We show how this may be achieved through the use of sequential Monte Carlo (SMC) samplers (Del…

Computation · Statistics 2020-06-02 Richard G Everitt , Richard Culliford , Felipe Medina-Aguayo , Daniel J Wilson

Utility based methods provide a very general theoretically consistent approach to pricing and hedging of securities in incomplete financial markets. Solving problems in the utility based framework typically involves dynamic programming,…

Probability · Mathematics 2008-12-10 M. R. Grasselli , T. R. Hurd

Minimax optimization problems have attracted a lot of attention over the past few years, with applications ranging from economics to machine learning. While advanced optimization methods exist for such problems, characterizing their…

Machine Learning · Computer Science 2024-02-21 Enea Monzio Compagnoni , Antonio Orvieto , Hans Kersting , Frank Norbert Proske , Aurelien Lucchi