English
Related papers

Related papers: BCMA-ES II: revisiting Bayesian CMA-ES

200 papers

This paper deals with the Elliptical Wishart and Inverse Elliptical Wishart distributions, which play a major role when handling covariance matrices. Similarly to multivariate elliptical distributions, these form a large family of…

Statistics Theory · Mathematics 2024-11-01 Imen Ayadi , Florent Bouchard , Frédéric Pascal

A Wishart kernel density estimator (KDE) is introduced for density estimation in the cone of positive definite matrices. The estimator is boundary-aware and mitigates the boundary bias suffered by conventional KDEs, while remaining simple…

Methodology · Statistics 2025-12-10 Léo R. Belzile , Christian Genest , Frédéric Ouimet , Donald Richards

Hyperparameters of deep neural networks are often optimized by grid search, random search or Bayesian optimization. As an alternative, we propose to use the Covariance Matrix Adaptation Evolution Strategy (CMA-ES), which is known for its…

Neural and Evolutionary Computing · Computer Science 2016-04-26 Ilya Loshchilov , Frank Hutter

Covariance Matrix Adaptation Evolution Strategy (CMA-ES) is a highly effective optimization technique. A primary challenge when applying CMA-ES in high dimensionality is sampling from a multivariate normal distribution with an arbitrary…

Neural and Evolutionary Computing · Computer Science 2026-01-05 Jarosław Arabas , Adam Stelmaszczyk , Eryk Warchulski , Dariusz Jagodziński , Rafał Biedrzycki

Finite mixtures of matrix normal distributions are a powerful tool for classifying three-way data in unsupervised problems. The distribution of each component is assumed to be a matrix variate normal density. The mixture model can be…

Methodology · Statistics 2013-03-07 Cinzia Viroli

We derive concentration inequalities for the spectral measure of large random matrices, allowing for certain forms of dependence. Our main focus is on empirical covariance (Wishart) matrices, but general symmetric random matrices are also…

Statistics Theory · Mathematics 2018-09-24 Adityanand Guntuboyina , Hannes Leeb

We present machine learning estimators for causal and predictive parameters under covariate shift, where covariate distributions differ between training and target populations. One such parameter is the average effect of a policy that…

Methodology · Statistics 2025-09-23 Victor Chernozhukov , Michael Newey , Whitney K Newey , Rahul Singh , Vasilis Syrgkanis

Component network meta-analysis (CNMA) models are an extension of standard network meta-analysis (NMA) models which account for the use of multicomponent treatments in the network. This article contributes innovatively to several…

Methodology · Statistics 2025-07-23 Augustine Wigle , Audrey Béliveau

We propose a Bayesian test of normality for univariate or multivariate data against alternative nonparametric models characterized by Dirichlet process mixture distributions. The alternative models are based on the principles of embedding…

Statistics Theory · Mathematics 2023-04-12 Surya T. Tokdar , Ryan Martin

We consider joint inversion for two or more unknown parameters from observational data in the Bayesian framework. Standard approaches often either treat the parameters as independent or impose structural similarity through regularisation…

Methodology · Statistics 2026-05-04 Ruanui Nicholson , Matti Niskanen , Oliver J. Maclaren , Jari P. Kaipio

Bayesian Model Averaging (BMA) is an application of Bayesian inference to the problems of model selection, combined estimation and prediction that produces a straightforward model choice criteria and less risky predictions. However, the…

Methodology · Statistics 2017-11-08 Tiago M. Fragoso , Francisco Louzada Neto

In conventional randomized controlled trials, adjustment for baseline values of covariates known to be at least moderately associated with the outcome increases the power of the trial. Recent work has shown particular benefit for more…

Methodology · Statistics 2023-11-27 James Willard , Shirin Golchi , Erica EM Moodie

The posterior in probabilistic programs with stochastic support decomposes as a weighted sum of the local posterior distributions associated with each possible program path. We show that making predictions with this full posterior…

Machine Learning · Computer Science 2024-04-15 Tim Reichelt , Luke Ong , Tom Rainforth

We present a proposal to deal with the non-normality issue in the context of regression models with measurement errors when both the response and the explanatory variable are observed with error. We extend the normal model by jointly…

Methodology · Statistics 2020-07-28 C. R. B. Cabral , N. L. de Souza , J. Leão

This paper develops a methodology for approximating the posterior first two moments of the posterior distribution in Bayesian inference. Partially specified probability models, which are defined only by specifying means and variances, are…

Methodology · Statistics 2009-01-27 K. Triantafyllopoulos , P. J. Harrison

In minimum trace (MinT) forecast reconciliation, the covariance matrix of the base forecasts errors plays a crucial role. Typically, this matrix is estimated and then treated as known. This can lead to underestimation of the variance of the…

Methodology · Statistics 2026-05-11 Chiara Carrara , Dario Azzimonti , Giorgio Corani , Lorenzo Zambon

For two vast families of mixture distributions and a given prior, we provide unified representations of posterior and predictive distributions. Model applications presented include bivariate mixtures of Gamma distributions labelled as…

Statistics Theory · Mathematics 2020-09-09 Aziz LMoudden , Éric Marchand

We introduced a generalized Wishart distribution, namely, the Kotz-Wishart distribution. Several existing results based on the normality assumption have been extended. Inspired by the particular form of the pdf of the Kotz-Wishart matrix,…

Statistics Theory · Mathematics 2014-04-18 Amadou Sarr

Finite mixtures of regressions with fixed covariates are a commonly used model-based clustering methodology to deal with regression data. However, they assume assignment independence, i.e. the allocation of data points to the clusters is…

Methodology · Statistics 2021-04-27 Salvatore D. Tomarchio , Paul D. McNicholas , Antonio Punzo

Estimation of the mean vector and covariance matrix is of central importance in the analysis of multivariate data. In the framework of generalized linear models, usually the variances are certain functions of the means with the normal…

Methodology · Statistics 2023-01-25 Anupam Kundu , Mohsen Pourahmadi