English
Related papers

Related papers: Leveraging priors on distribution functions for mu…

200 papers

Robust Bayesian inference using density power divergence (DPD) has emerged as a promising approach for handling outliers in statistical estimation. Although the DPD-based posterior offers theoretical guarantees of robustness, its practical…

Methodology · Statistics 2025-12-11 Naruki Sonobe , Tomotaka Momozaki , Tomoyuki Nakagawa

Thompson Sampling has recently been shown to be optimal in the Bernoulli Multi-Armed Bandit setting[Kaufmann et al., 2012]. This bandit problem assumes stationary distributions for the rewards. It is often unrealistic to model the real…

Machine Learning · Computer Science 2013-02-18 Joseph Mellor , Jonathan Shapiro

We consider an array of random variables, taking values in a complete and separable metric space, that exhibits a kind of symmetry which we call row exchangeability. Given such an array, a natural model for Bayesian nonparametric inference…

Statistics Theory · Mathematics 2025-10-10 Evan Donald , Jason Swanson

In this article, we consider a non-parametric Bayesian approach to multivariate quantile regression. The collection of related conditional distributions of a response vector Y given a univariate covariate X is modeled using a Dependent…

Methodology · Statistics 2020-07-03 Indrabati Bhattacharya , Subhashis Ghosal

We propose algorithms based on a multi-level Thompson sampling scheme, for the stochastic multi-armed bandit and its contextual variant with linear expected rewards, in the setting where arms are clustered. We show, both theoretically and…

Machine Learning · Computer Science 2022-06-16 Emil Carlsson , Devdatt Dubhashi , Fredrik D. Johansson

We study the problem of regret minimization in a multi-armed bandit setup where the agent is allowed to play multiple arms at each round by spreading the resources usually allocated to only one arm. At each iteration the agent selects a…

Machine Learning · Computer Science 2021-06-01 Matias I. Müller , Cristian R. Rojas

In this paper we propose the first multi-armed bandit algorithm based on re-sampling that achieves asymptotically optimal regret simultaneously for different families of arms (namely Bernoulli, Gaussian and Poisson distributions). Unlike…

Machine Learning · Statistics 2020-10-28 Dorian Baudry , Emilie Kaufmann , Odalric-Ambrym Maillard

Thompson sampling is a heuristic algorithm for the multi-armed bandit problem which has a long tradition in machine learning. The algorithm has a Bayesian spirit in the sense that it selects arms based on posterior samples of reward…

Machine Learning · Computer Science 2021-02-15 Yi Liu , Veronika Rockova

We introduce a novel varying-weight dependent Dirichlet process (DDP) model that extends a recently developed semi-parametric generalized linear model (SPGLM) by adding a nonparametric Bayesian prior on the baseline distribution of the GLM.…

Methodology · Statistics 2025-03-31 Entejar Alam , Paul J. Rathouz , Peter Mueller

Thompson Sampling algorithm is a well known Bayesian algorithm for solving stochastic multi-armed bandit. At each time step the algorithm chooses each arm with probability proportional to it being the current best arm. We modify the…

Machine Learning · Computer Science 2017-10-09 Qiang Ha

Recent advancements in diffusion models have been leveraged to address inverse problems without additional training, and Diffusion Posterior Sampling (DPS) (Chung et al., 2022a) is among the most popular approaches. Previous analyses…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Tongda Xu , Xiyan Cai , Xinjie Zhang , Xingtong Ge , Dailan He , Ming Sun , Jingjing Liu , Ya-Qin Zhang , Jian Li , Yan Wang

We consider applying multi-armed bandits to model-assisted designs for dose-finding clinical trials. Multi-armed bandits are very simple and powerful methods to determine actions to maximize a reward in a limited number of trials. Among the…

Methodology · Statistics 2022-01-17 Masahiro Kojima

Recent studies demonstrate that diffusion models can serve as a strong prior for solving inverse problems. A prominent example is Diffusion Posterior Sampling (DPS), which approximates the posterior distribution of data given the measure…

Machine Learning · Statistics 2024-09-16 Yaxuan Zhu , Zehao Dou , Haoxin Zheng , Yasi Zhang , Ying Nian Wu , Ruiqi Gao

We develop a new Gibbs sampler for a linear mixed model with a Dirichlet process random effect term, which is easily extended to a generalized linear mixed model with a probit link function. Our Gibbs sampler exploits the properties of the…

Statistics Theory · Mathematics 2010-02-26 Minjung Kyung , Jeff Gill , George Casella

In this paper, we provide an explicit probability distribution for classification purposes. It is derived from the Bayesian nonparametric mixture of Dirichlet process model, but with suitable modifications which remove unsuitable aspects of…

Applications · Statistics 2009-05-05 Ruth Fuentes-Garcia , Ramses H Mena , Stephen G Walker

In stochastic bandit problems, a Bayesian policy called Thompson sampling (TS) has recently attracted much attention for its excellent empirical performance. However, the theoretical analysis of this policy is difficult and its asymptotic…

Statistics Theory · Mathematics 2013-11-11 Junya Honda , Akimichi Takemura

We discuss a multiple-play multi-armed bandit (MAB) problem in which several arms are selected at each round. Recently, Thompson sampling (TS), a randomized algorithm with a Bayesian spirit, has attracted much attention for its empirically…

Machine Learning · Statistics 2019-03-22 Junpei Komiyama , Junya Honda , Hiroshi Nakagawa

In the stochastic multi-armed bandit problem, a randomized probability matching policy called Thompson sampling (TS) has shown excellent performance in various reward models. In addition to the empirical performance, TS has been shown to…

Machine Learning · Computer Science 2023-02-06 Jongyeong Lee , Junya Honda , Chao-Kai Chiang , Masashi Sugiyama

Many popular Bayesian nonparametric priors can be characterized in terms of exchangeable species sampling sequences. However, in some applications, exchangeability may not be appropriate. We introduce a {novel and probabilistically coherent…

Statistics Theory · Mathematics 2015-03-17 Edoardo M. Airoldi , Thiago Costa , Federico Bassetti , Fabrizio Leisen , Michele Guindani

In the usual Bayesian setting, a full probabilistic model is required to link the data and parameters, and the form of this model and the inference and prediction mechanisms are specified via de Finetti's representation. In general, such a…

Methodology · Statistics 2026-01-21 Yu Luo , David A. Stephens , Daniel J. Graham , Emma J. McCoy