English
Related papers

Related papers: Iterating marginalized Bayes maps for likelihood m…

200 papers

The performance of many machine learning models depends on their hyper-parameter settings. Bayesian Optimization has become a successful tool for hyper-parameter optimization of machine learning algorithms, which aims to identify optimal…

Machine Learning · Computer Science 2020-08-04 Lidan Wang , Franck Dernoncourt , Trung Bui

With the advance of experimental techniques such as time-lapse fluorescence microscopy, the availability of single-cell trajectory data has vastly increased, and so has the demand for computational methods suitable for parameter inference…

Quantitative Methods · Quantitative Biology 2016-07-06 Irena Kuzmanovska , Andreas Milias-Argeitis , Christoph Zechner , Mustafa Khammash

We generalize the approach of Liu and Lawrence (1999) for multiple changepoint problems where the number of changepoints is unknown. The approach is based on dynamic programming recursion for efficient calculation of the marginal…

Computation · Statistics 2009-09-29 Heng Lian

The latent stochastic block model is a flexible and widely used statistical model for the analysis of network data. Extensions of this model to a dynamic context often fail to capture the persistence of edges in contiguous network…

Methodology · Statistics 2018-04-16 Riccardo Rastelli

In the presence of modeling errors, the mainstream Bayesian methods seldom give a realistic account of uncertainties as they commonly underestimate the inherent variability of parameters. This problem is not due to any misconception in the…

Applications · Statistics 2020-05-19 Omid Sedehi , Costas Papadimitriou , Lambros S. Katafygiotis

In engineering, accurately modeling nonlinear dynamic systems from data contaminated by noise is both essential and complex. Established Sequential Monte Carlo (SMC) methods, used for the Bayesian identification of these systems, facilitate…

Machine Learning · Statistics 2024-04-25 Joe D. Longbottom , Max D. Champneys , Timothy J. Rogers

In parameter estimation problems one computes a posterior distribution over uncertain parameters defined jointly by a prior distribution, a model, and noisy data. Markov Chain Monte Carlo (MCMC) is often used for the numerical solution of…

Numerical Analysis · Mathematics 2017-11-15 Matthias Morzfeld , Marcus S. Day , Ray W. Grout , George Shu Heng Pau , Stefan A. Finsterle , John B. Bell

We introduce a flexible, scalable Bayesian inference framework for nonlinear dynamical systems characterised by distinct and hierarchical variability at the individual, group, and population levels. Our model class is a generalisation of…

Machine Learning · Statistics 2019-10-03 Geoffrey Roeder , Paul K. Grant , Andrew Phillips , Neil Dalchau , Edward Meeds

When inferring parameters from a Gaussian-distributed data set by computing a likelihood, a covariance matrix is needed that describes the data errors and their correlations. If the covariance matrix is not known a priori, it may be…

Cosmology and Nongalactic Astrophysics · Physics 2016-01-27 Elena Sellentin , Alan F. Heavens

Probabilistic programs with mixed support (both continuous and discrete latent random variables) commonly appear in many probabilistic programming systems (PPSs). However, the existence of the discrete random variables prohibits many basic…

Machine Learning · Computer Science 2020-03-06 David Tolpin , Yuan Zhou , Hongseok Yang

Doubly-intractable posterior distributions arise in many applications of statistics concerned with discrete and dependent data, including physics, spatial statistics, machine learning, the social sciences, and other fields. A specific…

Computation · Statistics 2021-05-20 Jaewoo Park , Ick Hoon Jin , Michael Schweinberger

Bayes factor, defined as the ratio of the marginal likelihood functions of two competing models, is the natural Bayesian procedure for model selection. Marginal likelihoods are usually computationally demanding and complex. This scenario is…

Methodology · Statistics 2022-09-09 Gabriel Calvo , Carmen Armero , Luigi Spezia , Maria Grazia Pennino

We seek to extract a small number of representative scenarios from large panel data that are consistent with sample moments. Among two novel algorithms, the first identifies scenarios that have not been observed before, and comes with a…

Machine Learning · Statistics 2024-11-06 Michael Multerer , Paul Schneider , Rohan Sen

We show that it is feasible to carry out exact Bayesian inference for non-Gaussian state space models using an adaptive Metropolis Hastings sampling scheme with the likelihood approximated by the particle filter. Furthermore, an adapyive…

Computation · Statistics 2009-11-03 Ralph Silva , Paolo Giordani , Robert Kohn , Mike Pitt

We propose sequential Monte Carlo based algorithms for maximum likelihood estimation of the static parameters in hidden Markov models with an intractable likelihood using ideas from approximate Bayesian computation. The static parameter…

Computation · Statistics 2013-11-19 Sinan Yildirim , Sumeetpal Singh , Thomas Dean , Ajay Jasra

Metrics of model goodness-of-fit, model comparison, and model parameter estimation are the main categories of statistical problems in science. Bayesian and frequentist methods that address these questions often rely on a likelihood…

Data Analysis, Statistics and Probability · Physics 2019-06-26 Carlos A. Argüelles , Austin Schneider , Tianlu Yuan

We consider nonlinear mixed effects models including high-dimensional covariates to model individual parameters variability. The objective is to identify relevant covariates among a large set under sparsity assumption and to estimate model…

Statistics Theory · Mathematics 2025-08-06 Antoine Caillebotte , Estelle Kuhn , Sarah Lemler

The key distinguishing property of a Bayesian approach is marginalization, rather than using a single setting of weights. Bayesian marginalization can particularly improve the accuracy and calibration of modern deep neural networks, which…

Machine Learning · Computer Science 2022-03-31 Andrew Gordon Wilson , Pavel Izmailov

Dynamical models of cognition play an increasingly important role in driving theoretical and experimental research in psychology. Therefore, parameter estimation, model analysis and comparison of dynamical models are of essential…

Switching dynamical systems are an expressive model class for the analysis of time-series data. As in many fields within the natural and engineering sciences, the systems under study typically evolve continuously in time, it is natural to…

Machine Learning · Computer Science 2022-05-19 Lukas Köhs , Bastian Alt , Heinz Koeppl