English
Related papers

Related papers: Cost of postselection in decision theory

200 papers

Feature Selection is a crucial procedure in Data Science tasks such as Classification, since it identifies the relevant variables, making thus the classification procedures more interpretable, cheaper in terms of measurement and more…

Machine Learning · Statistics 2024-01-17 Sandra Benítez-Peña , Rafael Blanquero , Emilio Carrizosa , Pepa Ramírez-Cobo

This paper extends my research applying statistical decision theory to treatment choice with sample data, using maximum regret to evaluate the performance of treatment rules. The specific new contribution is to study as-if optimization…

Econometrics · Economics 2021-10-05 Charles F. Manski

We model the joint distribution of choice probabilities and decision times in binary choice tasks as the solution to a problem of optimal sequential sampling, where the agent is uncertain of the utility of each action and pays a constant…

Neurons and Cognition · Quantitative Biology 2015-05-14 Drew Fudenberg , Philipp Strack , Tomasz Strzalecki

The goal of strategic classification is to learn decision rules which are robust to strategic input manipulation. Earlier works assume that these responses are known; while some recent works handle unknown responses, they exclusively study…

Machine Learning · Computer Science 2024-06-24 Elan Rosenfeld , Nir Rosenfeld

Despite remarkable progress made in natural language processing, even the state-of-the-art models often make incorrect predictions. Such predictions hamper the reliability of systems and limit their widespread adoption in real-world…

Computation and Language · Computer Science 2023-05-04 Neeraj Varshney , Chitta Baral

Predictive models are often used for real-time decision making. However, typical machine learning techniques ignore feature evaluation cost, and focus solely on the accuracy of the machine learning models obtained utilizing all the features…

Machine Learning · Computer Science 2014-08-19 Leilani Battle , Edward Benson , Aditya Parameswaran , Eugene Wu

The goal of classification with rejection is to avoid risky misclassification in error-critical applications such as medical diagnosis and product inspection. In this paper, based on the relationship between classification with rejection…

Machine Learning · Statistics 2021-09-30 Nontawat Charoenphakdee , Zhenghang Cui , Yivan Zhang , Masashi Sugiyama

We relate models based on costs of switching beliefs (e.g. due to inattention) to hypothesis tests. Specifically, for an inference problem with a penalty for mistakes and for switching the inferred value, a band of inaction is optimal. We…

General Economics · Economics 2018-08-30 Samuel N. Cohen , Timo Henckel , Gordon D. Menzies , Johannes Muhle-Karbe , Daniel J. Zizzo

Stochastic optimization problems often involve data distributions that change in reaction to the decision variables. This is the case for example when members of the population respond to a deployed classifier by manipulating their features…

Optimization and Control · Mathematics 2020-12-15 Dmitriy Drusvyatskiy , Lin Xiao

We address how one can empirically infer properties of quantum states generated by dynamics involving measurements. Our focus is on many-body settings where the number of measurements is extensive, making brute-force approaches based on…

Quantum Physics · Physics 2024-07-19 Max McGinley

Several branches of the potential outcome causal inference literature have discussed the merits of blocking versus complete randomization. Some have concluded it can never hurt the precision of estimates, and some have concluded it can…

Methodology · Statistics 2022-01-17 Nicole E. Pashley , Luke W. Miratrix

When interpreting A/B tests, we typically focus only on the statistically significant results and take them by face value. This practice, termed post-selection inference in the statistical literature, may negatively affect both point…

Applications · Statistics 2021-06-01 Alex Deng , Yicheng Li , Jiannan Lu , Vivek Ramamurthy

Online decision making aims to learn the optimal decision rule by making personalized decisions and updating the decision rule recursively. It has become easier than before with the help of big data, but new challenges also come along.…

Machine Learning · Statistics 2020-10-16 Haoyu Chen , Wenbin Lu , Rui Song

This paper deals with the state estimation problem in discrete-event systems modeled with nondeterministic finite automata, partially observed via a sensor measuring unit whose measurements (reported observations) may be vitiated by a…

Information Theory · Computer Science 2020-11-04 Yuting Li , Christoforos N. Hadjicostis , Naiqi Wu , Zhiwu Li

In many traditional job scheduling settings, it is assumed that one knows the time it will take for a job to complete service. In such cases, strategies such as shortest job first can be used to improve performance in terms of measures such…

Data Structures and Algorithms · Computer Science 2019-05-24 Michael Mitzenmacher

In critical applications, it is vital for classifiers to defer decision-making to humans. We propose a post-hoc method that makes existing classifiers selectively abstain from predicting certain samples. Our abstaining classifier is…

Machine Learning · Computer Science 2023-10-11 Tongxin Yin , Jean-François Ton , Ruocheng Guo , Yuanshun Yao , Mingyan Liu , Yang Liu

Voting can abstractly model any decision-making scenario and as such it has been extensively studied over the decades. Recently, the related literature has focused on quantifying the impact of utilizing only limited information in the…

Computer Science and Game Theory · Computer Science 2020-01-07 Aris Filos-Ratsikas , Evi Micha , Alexandros A. Voudouris

Encoding and decoding are the two key steps in information processing. In this work we study the encoding and decoding capabilities of operational theories in the context of information-storability game, where the task is to freely choose a…

Quantum Physics · Physics 2024-07-19 Teiko Heinosaari , Leevi Leppäjärvi , Martin Plávala

Device-independent certifications employ Bell tests to guarantee the proper functioning of an apparatus from the sole knowledge of observed measurement statistics, i.e. without assumptions on the internal functioning of the devices. When…

Quantum Physics · Physics 2020-03-04 Davide Orsucci , Jean-Daniel Bancal , Nicolas Sangouard , Pavel Sekatski

In conventional measurement, to reach the greatest accuracy of parameter estimation, all samples must be measured since each independent sample contains the same quantum Fisher information. In postselected metrology, postselection can…