English
Related papers

Related papers: Testing Optimality of Sequential Decision-Making

200 papers

Sequential decision making significantly speeds up research and is more cost-effective compared to fixed-n methods. We present a method for sequential decision making for stratified count data that retains Type-I error guarantee or false…

Methodology · Statistics 2023-02-23 Rosanne J. Turner , Peter D. Grünwald

There has long been debate about the relative merits of decision theoretic methods and heuristic rule-based approaches for reasoning under uncertainty. We report an experimental comparison of the performance of the two approaches to…

Artificial Intelligence · Computer Science 2013-04-10 Jayant Kalagnanam , Max Henrion

We first review existing sequential methods for estimating a binomial proportion. Afterward, we propose a new family of group sequential sampling schemes for estimating a binomial proportion with prescribed margin of error and confidence…

Statistics Theory · Mathematics 2013-11-05 Zhengjia Chen , Xinjia Chen

We consider the sequential composite binary hypothesis testing problem in which one of the hypotheses is governed by a single distribution while the other is governed by a family of distributions whose parameters belong to a known set…

Information Theory · Computer Science 2022-03-30 Jiachun Pan , Yonglong Li , Vincent Y. F. Tan

This short paper describes a numerical method for optimising the conservative confidence bound on the reliability of a system based on tests of its individual components. This is an alternative to the algorithmic approaches identified in…

Software Engineering · Computer Science 2022-02-01 Peter Bishop , Andrey Povyakalo

This paper proposes new specification tests for conditional models with discrete responses, which are key to apply efficient maximum likelihood methods, to obtain consistent estimates of partial effects and to get appropriate predictions of…

Statistics Theory · Mathematics 2018-02-01 Igor Kheifets , Carlos Velasco

This paper considers a problem where multiple users make repeated decisions based on their own observed events. The events and decisions at each time step determine the values of a utility function and a collection of penalty functions. The…

Optimization and Control · Mathematics 2013-05-13 Michael J. Neely

We consider sequential selection of an alternating subsequence from a sequence of independent, identically distributed, continuous random variables, and we determine the exact asymptotic behavior of an optimal sequentially selected…

Probability · Mathematics 2011-08-15 Alessandro Arlotto , Robert W. Chen , Lawrence A. Shepp , J. Michael Steele

Refining one's hypotheses in the light of data is a common scientific practice; however, the dependency on the data introduces selection bias and can lead to specious statistical analysis. An approach for addressing this is via conditioning…

Machine Learning · Computer Science 2020-03-03 Jen Ning Lim , Makoto Yamada , Wittawat Jitkrittum , Yoshikazu Terada , Shigeyuki Matsui , Hidetoshi Shimodaira

In this paper, we consider the problem of sequential binary hypothesis test in adversary environment based on observations from s sensors, with the caveat that a subset of c sensors is compromised by an adversary, whose observations can be…

Systems and Control · Electrical Eng. & Systems 2021-05-14 Zishuo Li , Yilin Mo , Fei Hao

The mean completion time of a stochastic process may be rendered finite and minimised by a judiciously chosen restart protocol, which may either be stochastic or deterministic. Here we study analytically an arbitrary stochastic search…

Quantitative Methods · Quantitative Biology 2016-09-14 Kabir Husain , Sandeep Krishna

While many statistical procedures rely on a fixed sample size, sequential methods allow a decision-maker to adapt the sample size to achieve a given precision. In this way, sequential tests reduce the average number of observations required…

Statistics Theory · Mathematics 2026-03-03 Henri Doerks , Erik Ekström , Yuqiong Wang

Under a generalised estimating equation analysis approach, approximate design theory is used to determine Bayesian D-optimal designs. For two examples, considering simple exchangeable and exponential decay correlation structures, we compare…

Methodology · Statistics 2024-02-16 Laura Etfer , James M. S. Wason , Michael J. Grayling

A simple and common type of medical research involves the comparison of one treatment against another. The logical aim should be both to establish which treatment is superior and the strength of evidence supporting this conclusion, a task…

Methodology · Statistics 2022-12-08 Nicholas Adams

We study "active" decision making over sensor networks where the sensors' sequential probing actions are actively chosen by continuously learning from past observations. We consider two network settings: with and without central…

Methodology · Statistics 2020-11-30 Anshuka Rangi , Massimo Franceschetti , Stefano Marano

Sequential methods for quantum hypothesis testing offer significant advantages over fixed-length approaches, which rely on a predefined number of state copies. Despite their potential, these methods remain underexplored for unambiguous…

Quantum Physics · Physics 2025-11-26 Jordi Pérez-Guijarro , Alba Pagès-Zamora , Javier R. Fonollosa

This survey is focused on certain sequential decision-making problems that involve optimizing over probability functions. We discuss the relevance of these problems for learning and control. The survey is organized around a framework that…

Optimization and Control · Mathematics 2023-01-13 Emiland Garrabe , Giovanni Russo

Bayesian optimal experiments that maximize the information gained from collected data are critical to efficiently identify behavioral models. We extend a seminal method for designing Bayesian optimal experiments by introducing two…

Applications · Statistics 2025-03-19 Stefano Balietti , Brennan Klein , Christoph Riedl

A collaborative distributed binary decision problem is considered. Two statisticians are required to declare the correct probability measure of two jointly distributed memoryless process, denoted by $X^n=(X_1,\dots,X_n)$ and…

Information Theory · Computer Science 2016-04-11 Gil Katz , Pablo Piantanida , Merouane Debbah

We consider hypothesis testing of binary causal queries using observational data. Since the mapping of causal models to the observational distribution that they induce is not one-to-one, in general, causal queries are often only partially…

Methodology · Statistics 2026-02-27 Sourbh Bhadane , Joris M. Mooij , Philip Boeken , Onno Zoeter