English
Related papers

Related papers: BCMA-ES: A Bayesian approach to CMA-ES

200 papers

In contrast to previous analyses, we demonstrate a Bayesian approach to the estimation of the CKM phase $\alpha$ that is invariant to parameterization. We also show that in addition to {\em computing} the marginal posterior in a Bayesian…

High Energy Physics - Phenomenology · Physics 2009-03-31 Robin D. Morris , Johann Cohen-Tanugi

Meta-learning has proven to be successful for few-shot learning across the regression, classification, and reinforcement learning paradigms. Recent approaches have adopted Bayesian interpretations to improve gradient-based meta-learners by…

Machine Learning · Computer Science 2020-12-01 Amrith Setlur , Saket Dingliwal , Barnabas Poczos

This paper develops some objective priors for certain parameters of the bivariate normal distribution. The parameters considered are the regression coefficient, the generalized variance, and the ratio of the conditional variance of one…

Statistics Theory · Mathematics 2008-12-18 Malay Ghosh , Upasana Santra , Dalho Kim

The Expectation-Maximization (EM) algorithm is a fundamental tool in unsupervised machine learning. It is often used as an efficient way to solve Maximum Likelihood (ML) estimation problems, especially for models with latent variables. It…

Quantum Physics · Physics 2020-07-08 Iordanis Kerenidis , Alessandro Luongo , Anupam Prakash

In the post-Moore era, main performance gains of black-box optimizers are increasingly depending on parallelism, especially for large-scale optimization (LSO). Here we propose to parallelize the well-established covariance matrix adaptation…

Neural and Evolutionary Computing · Computer Science 2024-10-14 Qiqi Duan , Chang Shao , Guochen Zhou , Minghan Zhang , Qi Zhao , Yuhui Shi

In this study, we consider a continuous min--max optimization problem $\min_{x \in \mathbb{X} \max_{y \in \mathbb{Y}}}f(x,y)$ whose objective function is a black-box. We propose a novel approach to minimize the worst-case objective function…

Neural and Evolutionary Computing · Computer Science 2023-03-29 Atsuhiro Miyagi , Yoshiki Miyauchi , Atsuo Maki , Kazuto Fukuchi , Jun Sakuma , Youhei Akimoto

We introduce an acceleration for covariance matrix adaptation evolution strategies (CMA-ES) by means of adaptive diagonal decoding (dd-CMA). This diagonal acceleration endows the default CMA-ES with the advantages of separable CMA-ES…

Neural and Evolutionary Computing · Computer Science 2019-05-16 Youhei Akimoto , Nikolaus Hansen

A new maximum approximate likelihood (ML) estimation algorithm for the mixture of Kent distribution is proposed. The new algorithm is constructed via the BSLM (block successive lower-bound maximization) framework and incorporates manifold…

Computation · Statistics 2017-09-15 Hien D. Nguyen

Various methods have been developed to combine inference across multiple sets of results for unsupervised clustering, within the ensemble clustering literature. The approach of reporting results from one `best' model out of several…

Neural networks make accurate predictions but often fail to provide reliable uncertainty estimates, especially under covariate distribution shifts between training and testing. To address this problem, we propose a Bayesian framework for…

Machine Learning · Statistics 2025-12-22 Yuli Slavutsky , David M. Blei

The interest in accelerating black-box optimizers has resulted in several surrogate model-assisted version of the Covariance Matrix Adaptation Evolution Strategy, a state-of-the-art continuous black-box optimizer. The version called…

Neural and Evolutionary Computing · Computer Science 2017-10-02 Jakub Repicky , Lukas Bajer , Zbynek Pitra , Martin Holena

Insurance products frequently cover significant claims arising from a variety of sources. To model losses from these products accurately, actuarial models must account for high-severity claims. A widely used strategy is to apply a mixture…

Methodology · Statistics 2025-04-30 Sébastien Jessup , Mélina Mailhot , Mathieu Pigeon

We study the conjugacy approximation method in the context of Bayesian ranking and selection with unknown correlations. Under the assumption of normal-inverse-Wishart prior distribution, the posterior distribution remains a…

Computation · Statistics 2017-11-16 Qiong Zhang , Yongjia Song

Covariance estimation and selection for multivariate datasets in a high-dimensional regime is a fundamental problem in modern statistics. Gaussian graphical models are a popular class of models used for this purpose. Current Bayesian…

Methodology · Statistics 2019-03-06 Xuan Cao , Shaojun Zhang

Fitted probabilities from widely used Bayesian multinomial probit models can depend strongly on the choice of a base category, which is used to uniquely identify the parameters of the model. This paper proposes a novel identification…

Methodology · Statistics 2020-05-19 Lane F. Burgette , David Puelz , P. Richard Hahn

The posterior in probabilistic programs with stochastic support decomposes as a weighted sum of the local posterior distributions associated with each possible program path. We show that making predictions with this full posterior…

Machine Learning · Computer Science 2024-04-15 Tim Reichelt , Luke Ong , Tom Rainforth

Approximate Bayesian computation methods can be used to evaluate posterior distributions without having to calculate likelihoods. In this paper we discuss and apply an approximate Bayesian computation (ABC) method based on sequential Monte…

Computation · Statistics 2009-01-15 Tina Toni , David Welch , Natalja Strelkowa , Andreas Ipsen , Michael P. H. Stumpf

This paper discusses regularized estimators in the multivariate statistical model as tools naturally arising within a Bayesian framework. First, a link is established between Bayesian estimation and inference under parameter rounding…

Methodology · Statistics 2025-09-15 Jan Kalina

This paper proposes a general switching dynamical system model, and a custom majorization-minimization-based algorithm EM++ for identifying its parameters. For certain families of distributions, such as Gaussian distributions, this…

Optimization and Control · Mathematics 2025-12-30 Renzi Wang , Alexander Bodard , Mathijs Schuurmans , Panagiotis Patrinos

In this paper, Bayesian parameter estimation through the consideration of the Maximum A Posteriori (MAP) criterion is revisited under the prism of the Expectation-Maximization (EM) algorithm. By incorporating a sparsity-promoting penalty…

Systems and Control · Computer Science 2015-08-06 Rodrigo Carvajal , Juan C. Agüero , Boris I. Godoy , Dimitrios Katselis