English
Related papers

Related papers: Nonparametric Bayesian multi-armed bandits for sin…

200 papers

Current methods for sequence tagging, a core task in NLP, are data hungry, which motivates the use of crowdsourcing as a cheap way to obtain labelled data. However, annotators are often unreliable and current aggregation methods cannot…

Computation and Language · Computer Science 2019-09-09 Edwin Simpson , Iryna Gurevych

Mobile health (mHealth) programs face a critical challenge in optimizing the timing of automated health information calls to beneficiaries. This challenge has been formulated as a collaborative multi-armed bandit problem, requiring online…

Machine Learning · Computer Science 2024-10-31 Arpan Dasgupta , Gagan Jain , Arun Suggala , Karthikeyan Shanmugam , Milind Tambe , Aparna Taneja

Sampling from distributions to find the one with the largest mean arises in a broad range of applications, and it can be mathematically modeled as a multi-armed bandit problem in which each distribution is associated with an arm. This paper…

Machine Learning · Statistics 2013-06-18 Kevin Jamieson , Matthew Malloy , Robert Nowak , Sebastien Bubeck

We aim at modelling the appearance of distinct tags in a sequence of labelled objects. Common examples of this type of data include words in a corpus or distinct species in a sample. These sequential discoveries are often summarised via…

Methodology · Statistics 2020-11-16 Alessandro Zito , Tommaso Rigon , Otso Ovaskainen , David Dunson

There has been a recent surge of interest in nonparametric bandit algorithms based on subsampling. One drawback however of these approaches is the additional complexity required by random subsampling and the storage of the full history of…

Artificial Intelligence · Computer Science 2021-06-22 Dorian Baudry , Yoan Russac , Olivier Cappé

We introduce Stacked Thompson Bandits (STB) for efficiently generating plans that are likely to satisfy a given bounded temporal logic requirement. STB uses a simulation for evaluation of plans, and takes a Bayesian approach to using the…

Software Engineering · Computer Science 2017-03-01 Lenz Belzner , Thomas Gabor

Markov Chain Monte Carlo (MCMC) is a well-established family of algorithms primarily used in Bayesian statistics to sample from a target distribution when direct sampling is challenging. Existing work on Bayesian decision trees uses MCMC.…

Computation · Statistics 2023-01-24 Efthyvoulos Drousiotis , Paul G. Spirakis , Simon Maskell

Bayesian Optimization is a useful tool for experiment design. Unfortunately, the classical, sequential setting of Bayesian Optimization does not translate well into laboratory experiments, for instance battery design, where measurements may…

Machine Learning · Computer Science 2023-02-24 Jose Pablo Folch , Robert M Lee , Behrang Shafei , David Walz , Calvin Tsay , Mark van der Wilk , Ruth Misener

Background: Single-cell RNA sequencing (scRNA-seq) is a powerful profiling technique at the single-cell resolution. Appropriate analysis of scRNA-seq data can characterize molecular heterogeneity and shed light into the underlying cellular…

Applications · Statistics 2019-08-05 Siamak Zamani Dadaneh , Paul de Figueiredo , Sing-Hoi Sze , Mingyuan Zhou , Xiaoning Qian

We extend Bayesian multi-armed bandit (MAB) algorithms beyond their original setting by making use of sequential Monte Carlo (SMC) methods. A MAB is a sequential decision making problem where the goal is to learn a policy that maximizes…

Machine Learning · Statistics 2024-04-08 Iñigo Urteaga , Chris H. Wiggins

The advent of single-cell sequencing opens new avenues for personalized treatment. In this paper, we address a two-level clustering problem of simultaneous subject subgroup discovery (subject level) and cell type detection (cell level) for…

Methodology · Statistics 2021-02-23 Qiuyu Wu , Xiangyu Luo

We consider the problem of jointly testing multiple hypotheses and estimating a random parameter of the underlying distribution. This problem is investigated in a sequential setup under mild assumptions on the underlying random process. The…

Signal Processing · Electrical Eng. & Systems 2021-05-07 Dominik Reinhard , Michael Fauß , Abdelhak M. Zoubir

In this report, we survey Bayesian Optimization methods focussed on the Multi-Armed Bandit Problem. We take the help of the paper "Portfolio Allocation for Bayesian Optimization". We report a small literature survey on the acquisition…

Machine Learning · Computer Science 2020-12-16 Abhilash Nandy , Chandan Kumar , Deepak Mewada , Soumya Sharma

Drawing a sample from a discrete distribution is one of the building components for Monte Carlo methods. Like other sampling algorithms, discrete sampling suffers from the high computational burden in large-scale inference problems. We…

Machine Learning · Statistics 2016-04-29 Yutian Chen , Zoubin Ghahramani

Thompson sampling is a popular algorithm for solving multi-armed bandit problems, and has been applied in a wide range of applications, from website design to portfolio optimization. In such applications, however, the number of choices (or…

Methodology · Statistics 2021-01-19 Simon Mak , Yuanshuo Zhou , Lavonne Hoang , C. F. Jeff Wu

Large biological datasets are being produced at a rapid pace and create substantial storage challenges, particularly in the domain of high-throughput sequencing (HTS). Most approaches currently used to store HTS data are either unable to…

Quantitative Methods · Quantitative Biology 2014-03-05 Fabien Campagne , Kevin C. Dorff , Nyasha Chambwe , James T. Robinson , Jill P. Mesirov , Thomas D. Wu

In this work, we study Bayesian quantum parameter estimation given a finite number of uses of the process encoding one or more unknown physical quantities. For multiple uses, it is conventional to classify quantum metrological protocols as…

Quantum Physics · Physics 2026-02-11 Erik L. André , Jessica Bavaresco , Mohammad Mehboudi

We propose a distributed computing framework, based on a divide and conquer strategy and hierarchical modeling, to accelerate posterior inference for high-dimensional Bayesian factor models. Our approach distributes the task of…

Methodology · Statistics 2016-12-30 Gautam Sabnis , Debdeep Pati , Barbara Engelhardt , Natesh Pillai

Statistical offices face a familiar and intensifying dilemma: rising demand for detailed regional and domain-level estimates under budgets that are fixed or shrinking. National statistical offices (NSOs) either ignore the problem of optimal…

Methodology · Statistics 2026-03-19 Siu-Ming Tam

The single-cell RNA sequencing (scRNA-seq) technology enables researchers to study complex biological systems and diseases with high resolution. The central challenge is synthesizing enough scRNA-seq samples; insufficient samples can impede…

Genomics · Quantitative Biology 2023-12-25 Yixuan Wang , Shuangyin Li , Shimin DI , Lei Chen