English
Related papers

Related papers: Partial Likelihood Thompson Sampling

200 papers

In this paper we explore partial coherence as a tool for evaluating causal influence of one signal sequence on another. In some cases the signal sequence is sampled from a time- or space-series. The key idea is to establish a connection…

Signal Processing · Electrical Eng. & Systems 2021-12-09 Louis L. Scharf , Yuan Wang

Inference for partially observed Markov process models has been a longstanding methodological challenge with many scientific and engineering applications. Iterated filtering algorithms maximize the likelihood function for partially observed…

Statistics Theory · Mathematics 2012-11-26 Edward L. Ionides , Anindya Bhadra , Yves Atchadé , Aaron King

Detection of rare traits or diseases in a large population is challenging. Pool testing allows covering larger swathes of population at a reduced cost, while simplifying logistics. However, testing precision decreases as it becomes unclear…

Information Theory · Computer Science 2021-06-22 Éric Brier , Megi Dervishi , Rémi Géraud-Stewart , David Naccache , Ofer Yifrach-Stav

Thompson sampling has impressive empirical performance for many multi-armed bandit problems. But current algorithms for Thompson sampling only work for the case of conjugate priors since these algorithms require to infer the posterior,…

Machine Learning · Computer Science 2017-08-17 Yichi Zhou , Jun Zhu , Jingwei Zhuo

Estimating prevalence, the fraction of a population with a certain medical condition, is fundamental to epidemiology. Traditional methods rely on classification of test samples taken at random from a population. Such approaches to…

Methodology · Statistics 2022-03-25 Paul Patrone , Anthony Kearsley

Developing accurate and reliable methods to estimate vaccine protection is a key goal in immunology and public health. While several statistical methods have been proposed, their potential inaccuracy in capturing fast intra-seasonal waning…

Quantitative Methods · Quantitative Biology 2022-05-26 Ariel Nikas , Hasan Ahmed , Veronika I. Zarnitsyna

Thompson sampling (TS) is a Bayesian randomized exploration strategy that samples options (e.g., system parameters or control laws) from the current posterior and then applies the selected option that is optimal for a task, thereby…

Machine Learning · Computer Science 2026-02-06 Kaikai Zheng , Dawei Shi , Yang Shi , Long Wang

For time-to-event data with finitely many competing risks, the proportional hazards model has been a popular tool for relating the cause-specific outcomes to covariates [Prentice et al. Biometrics 34 (1978) 541--554]. This article studies…

Statistics Theory · Mathematics 2009-03-04 Yanqing Sun , Peter B. Gilbert , Ian W. McKeague

We consider the problem of statistical inference when the data is collected via a Thompson Sampling-type algorithm. While Thompson Sampling (TS) is known to be both asymptotically optimal and empirically effective, its adaptive sampling…

Machine Learning · Statistics 2026-03-17 Budhaditya Halder , Shubhayan Pan , Koulik Khamaru

With the present highly infectious dominant SARS-CoV-2 strain of B1.1.529 or Omicron spreading around the globe, there is concern that the COVID-19 pandemic will not end soon and that it will be a race against time until a more contagious…

Populations and Evolution · Quantitative Biology 2022-04-26 Chottiwatt Jittprasong

We investigate properties of Thompson Sampling in the stochastic multi-armed bandit problem with delayed feedback. In a setting with i.i.d delays, we establish to our knowledge the first regret bounds for Thompson Sampling with arbitrary…

Machine Learning · Computer Science 2022-05-24 Han Wu , Stefan Wager

In this article we consider likelihood-based estimation of static parameters for a class of partially observed McKean-Vlasov (POMV) diffusion process with discrete-time observations over a fixed time interval. In particular, using the…

Methodology · Statistics 2024-11-12 Ajay Jasra , Mohamed Maama , Raul Tempone

Vaccination has played an important role in preventing the spread of infectious diseases. However, the limited availability of vaccines and personnel at the roll-out of a new vaccine and the costs of vaccination campaigns often limit how…

Physics and Society · Physics 2026-01-27 Rowan Hoogervorst , Evelien van der Hurk , David Pisinger

Monte Carlo methods to evaluate and maximize the likelihood function enable the construction of confidence intervals and hypothesis tests, facilitating scientific investigation using models for which the likelihood function is intractable.…

Methodology · Statistics 2017-02-13 Edward L. Ionides , Carles Breto , Joonha Park , Richard A. Smith , Aaron A. King

Thompson Sampling provides an efficient technique to introduce prior knowledge in the multi-armed bandit problem, along with providing remarkable empirical performance. In this paper, we revisit the Thompson Sampling algorithm under rewards…

Machine Learning · Computer Science 2019-12-09 Abhimanyu Dubey , Alex Pentland

We propose a new method to immunize populations or computer networks against epidemics which is more efficient than any method considered before. The novelty of our method resides in the way of determining the immunization targets. First we…

Physics and Society · Physics 2015-06-03 Christian M. Schneider , Tamara Mihaljev , Hans J. Herrmann

The paper is focused on the problem of estimating the probability $p$ of individual contaminated sample, under group testing. The precision of the estimator is given by the probability of proportional closeness, a concept defined in the…

Statistics Theory · Mathematics 2017-12-27 Yaakov Malinovsky , Shelemyahu Zacks

The authors propose a robust semi-parametric empirical likelihood method to integrate all available information from multiple samples with a common center of measurements. Two different sets of estimating equations are used to improve the…

Methodology · Statistics 2012-10-03 Hsiao-Hsuan Wang , Yuehua Wu , Yuejiao Fu , Xiaogang Wang

Viral load (VL) in the respiratory tract is the leading proxy for assessing infectiousness potential. Understanding the dynamics of disease-related VL within the host is very important and help to determine different policy and health…

Applications · Statistics 2023-08-21 Yonatan Woodbridge , Micha Mandel , Yair Goldberg , Amit Huppert

This technical note presents a new approach to carrying out the kind of exploration achieved by Thompson sampling, but without explicitly maintaining or sampling from posterior distributions. The approach is based on a bootstrap technique…

Machine Learning · Statistics 2015-07-02 Ian Osband , Benjamin Van Roy