English
Related papers

Related papers: Discrete Sequential Barycenter Arrays: Representat…

200 papers

In this paper we propose a new deterministic approximation method, called discretization approximation, for Bayesian computation. Discretization approximation is very simple to understand and to implement, It only requires calculating…

Computation · Statistics 2026-01-13 Shifeng Xiong

A new class of nonparametric prior distributions, termed Beta-Binomial stick-breaking process, is proposed. By allowing the underlying length random variables to be dependent through a Beta marginals Markov chain, an appealing discrete…

Statistics Theory · Mathematics 2020-08-12 María F. Gil-Leyva , Ramsés H. Mena , Theodoros Nicoleris

Density estimation plays a fundamental role in many areas of statistics and machine learning. Parametric, nonparametric and semiparametric density estimation methods have been proposed in the literature. Semiparametric density models are…

Statistics Theory · Mathematics 2019-01-11 Jian Shi , Jiahui Yu , Anna Liu , Yuedong Wang

We investigate statistical properties of a likelihood approach to nonparametric estimation of a singular distribution using deep generative models. More specifically, a deep generative model is used to model high-dimensional data that are…

Machine Learning · Statistics 2023-03-29 Minwoo Chae , Dongha Kim , Yongdai Kim , Lizhen Lin

Distributed consensus in the Wasserstein metric space of probability measures on the real line is introduced in this work. Convergence of each agent's measure to a common measure is proven under a weak network connectivity condition. The…

Optimization and Control · Mathematics 2021-10-04 Adrian N. Bishop , Arnaud Doucet

Randomness in financial markets requires modern and robust multivariate models of risk measures. This paper proposes a new approach for modeling multivariate risk measures under Wasserstein barycenters of probability measures supported on…

Applications · Statistics 2020-08-14 M. Andrea Arias-Serna , Jean-Michel Loubes , Francisco J. Caro-Lopera

This paper provides a non-asymptotic analysis of linear stochastic approximation (LSA) algorithms with fixed stepsize. This family of methods arises in many machine learning tasks and is used to obtain approximate solutions of a linear…

Machine Learning · Statistics 2021-06-03 Alain Durmus , Eric Moulines , Alexey Naumov , Sergey Samsonov , Kevin Scaman , Hoi-To Wai

This paper considers extensions of minimum-disparity estimators to the problem of estimating parameters in a regression model that is conditionally specified; that is where a parametric model describes the distribution of a response $y$…

Statistics Theory · Mathematics 2016-02-10 Giles Hooker

Sample average approximation (SAA) is a widely popular approach to data-driven decision-making under uncertainty. Under mild assumptions, SAA is both tractable and enjoys strong asymptotic performance guarantees. Similar guarantees,…

Optimization and Control · Mathematics 2016-11-03 Dimitris Bertsimas , Vishal Gupta , Nathan Kallus

This article is motivated by challenges in conducting Bayesian inferences on unknown discrete distributions, with a particular focus on count data. To avoid the computational disadvantages of traditional mixture models, we develop a novel…

Methodology · Statistics 2025-11-12 Davide Agnoletto , Tommaso Rigon , David B. Dunson

Non-uniform sampling arises when an experimenter does not have full control over the sampling characteristics of the process under investigation. Moreover, it is introduced intentionally in algorithms such as Bayesian optimization and…

Machine Learning · Statistics 2020-07-03 Stijn de Waele

We introduce a density basis of the trigonometric polynomials that is suitable to mixture modelling. Statistical and geometric properties are derived, suggesting it as a circular analogue to the Bernstein polynomial densities. Nonparametric…

Methodology · Statistics 2019-02-26 Olivier Binette , Simon Guillotte

Obtaining guarantees on the convergence of the minimizers of empirical risks to the ones of the true risk is a fundamental matter in statistical learning. Instead of deriving guarantees on the usual estimation error, the goal of this paper…

Statistics Theory · Mathematics 2024-09-12 Paul Escande

We study the existence and uniqueness of the barycenter of a signed distribution of probability measures on a Hilbert space. The barycenter is found, as usual, as a minimum of a functional. In the case where the positive part of the signed…

Probability · Mathematics 2025-07-08 Francesco Tornabene , Marco Veneroni , Giuseppe Savaré

We introduce the first probabilistic framework tailored for sequential random projection, an approach rooted in the challenges of sequential decision-making under uncertainty. The analysis is complicated by the sequential dependence and…

Statistics Theory · Mathematics 2024-05-14 Yingru Li

One of the fundamental problems in machine learning is the estimation of a probability distribution from data. Many techniques have been proposed to study the structure of data, most often building around the assumption that observations…

Machine Learning · Statistics 2013-02-22 Oren Rippel , Ryan Prescott Adams

Ensemble forecasts and their combination are examined from the perspective of probability spaces. Manipulating ensemble forecasts as discrete probability distributions, multi-model ensemble (MME) forecasts are reformulated as barycenters of…

Applications · Statistics 2025-03-24 Camille Le Coz , Alexis Tantet , Rémi Flamary , Riwal Plougonven

Neural networks and other machine learning models compute continuous representations, while humans communicate with discrete symbols. Reconciling these two forms of communication is desirable to generate human-readable interpretations or to…

Machine Learning · Computer Science 2021-04-05 André F. T. Martins

Bayesian model comparison (BMC) offers a principled probabilistic approach to study and rank competing models. In standard BMC, we construct a discrete probability distribution over the set of possible models, conditional on the observed…

Machine Learning · Statistics 2023-02-22 Marvin Schmitt , Stefan T. Radev , Paul-Christian Bürkner

Constructing accurate model-agnostic explanations for opaque machine learning models remains a challenging task. Classification models for high-dimensional data, like images, are often inherently complex. To reduce this complexity,…

Machine Learning · Computer Science 2020-10-26 Georgios Vlassopoulos , Tim van Erven , Henry Brighton , Vlado Menkovski