English
Related papers

Related papers: Bayesian Generalization Error of Poisson Mixture a…

200 papers

One of the main concepts in quantum physics is a density matrix, which is a symmetric positive definite matrix of trace one. Finite probability distributions can be seen as a special case when the density matrix is restricted to be…

Quantum Physics · Physics 2009-01-12 Manfred K Warmuth , Dima Kuzmin

The normalized maximized likelihood (NML) provides the minimax regret solution in universal data compression, gambling, and prediction, and it plays an essential role in the minimum description length (MDL) method of statistical modeling…

Information Theory · Computer Science 2014-01-29 Andrew Barron , Teemu Roos , Kazuho Watanabe

Density aggregation is a central problem in machine learning, for instance when combining predictions from a Deep Ensemble. The choice of aggregation remains an open question with two commonly proposed approaches being linear pooling…

Conventional approximations to Bayesian inference rely on either approximations by statistics such as mean and covariance or by point particles. Recent advances such as the ensemble Gaussian mixture filter have generalized these notions to…

Optimization and Control · Mathematics 2025-04-10 Andrey A Popov

In Bayesian nonparametric inference, random discrete probability measures are commonly used as priors within hierarchical mixture models for density estimation and for inference on the clustering of the data. Recently, it has been shown…

Statistics Theory · Mathematics 2012-11-26 Stefano Favaro , Antonio Lijoi , Igor Prünster

Counting experiments often rely on Monte Carlo simulations for predictions of Poisson expectations. The accompanying uncertainty from the finite Monte Carlo sample size can be incorporated into parameter estimation by modifying the Poisson…

Instrumentation and Methods for Astrophysics · Physics 2020-04-22 Thorsten Glüsenkamp

Learning machines which have hierarchical structures or hidden variables are singular statistical models because they are nonidentifiable and their Fisher information matrices are singular. In singular statistical models, neither the Bayes…

Machine Learning · Computer Science 2009-05-11 Sumio Watanabe

We show that spectral fluctuation of interaction matrices of yeast a core protein interaction network and a metabolic network follows the description of the Gaussian orthogonal ensemble (GOE) of random matrix theory (RMT). Furthermore, we…

Molecular Networks · Quantitative Biology 2009-11-11 Feng Luo , Jianxin Zhong , Yunfeng Yang , Richard H. Scheuermann , Jizhong Zhou

Three-way data structures, characterized by three entities, the units, the variables and the occasions, are frequent in biological studies. In RNA sequencing, three-way data structures are obtained when high-throughput transcriptome…

Methodology · Statistics 2022-06-22 Anjali Silva , Steven J. Rothstein , Paul D. McNicholas , Xiaoke Qin , Sanjeena Subedi

Bayesian variable selection requires sampling from a posterior distribution that combines discrete model indicators with continuously varying parameters, a challenge often addressed through reversible jump Markov chain Monte Carlo (RJMCMC).…

Methodology · Statistics 2026-05-01 Don van den Bergh , Merlise A. Clyde , Adrian E. Raftery , Maarten Marsman

The log canonical threshold (lct) is a fundamental invariant in birational geometry, essential for understanding the complexity of singularities in algebraic varieties. Its real counterpart, the real log canonical threshold (rlct), also…

Algebraic Geometry · Mathematics 2026-01-15 Dimitra Kosta , Daniel Windisch

One of the main research areas in Bayesian Nonparametrics is the proposal and study of priors which generalize the Dirichlet process. Here we exploit theoretical properties of Poisson random measures in order to provide a comprehensive…

Statistics Theory · Mathematics 2007-06-13 Lancelot F. James , Antonio Lijoi , Igor Pruenster

In many, if not most, machine learning applications the training data is naturally heterogeneous (e.g. federated learning, adversarial attacks and domain adaptation in neural net training). Data heterogeneity is identified as one of the…

Machine Learning · Statistics 2025-04-30 Harsh Vardhan , Avishek Ghosh , Arya Mazumdar

Parker and L\^e introduced random butterfly transforms (RBTs) as a preprocessing technique to replace pivoting in dense LU factorization. Unfortunately, their FFT-like recursive structure restricts the dimensions of the matrix. Furthermore,…

Numerical Analysis · Mathematics 2024-10-14 Neil Lindquist , Piotr Luszczek , Jack Dongarra

We exploit a suitable moment-based characterization of the mixture of Poisson distribution for developing Bayesian inference for the unknown size of a finite population whose units are subject to multiple occurrences during an enumeration…

Methodology · Statistics 2018-06-19 Danilo Alunni Fegatelli , Luca Tardella

We investigate the spectra of adjacency matrices of multiplex networks under random matrix theory (RMT) framework. Through extensive numerical experiments, we demonstrate that upon multiplexing two random networks, the spectra of the…

Statistical Mechanics · Physics 2021-11-10 Tanu Raghav , Sarika Jalan

This work performs a non-asymptotic analysis of the generalized Lasso under the assumption of sub-exponential data. Our main results continue recent research on the benchmark case of (sub-)Gaussian sample distributions and thereby explore…

Statistics Theory · Mathematics 2023-01-18 Martin Genzel , Christian Kipp

The two parameter Poisson-Dirichlet Process (PDP), a generalisation of the Dirichlet Process, is increasingly being used for probabilistic modelling in discrete areas such as language technology, bioinformatics, and image analysis. There is…

Statistics Theory · Mathematics 2012-02-17 Wray Buntine , Marcus Hutter

Generalised linear models for multi-class classification problems are one of the fundamental building blocks of modern machine learning tasks. In this manuscript, we characterise the learning of a mixture of $K$ Gaussians with generic means…

We study full Bayesian procedures for sparse linear regression when errors have a symmetric but otherwise unknown distribution. The unknown error distribution is endowed with a symmetrized Dirichlet process mixture of Gaussians. For the…

Statistics Theory · Mathematics 2019-03-26 Minwoo Chae , Lizhen Lin , David B. Dunson