English
Related papers

Related papers: Policy Learning with Asymmetric Counterfactual Uti…

200 papers

We provide sufficient conditions under which a utility function may be recovered from a finite choice experiment. Identification, as is commonly understood in decision theory, is not enough. We provide a general recoverability result that…

Theoretical Economics · Economics 2023-01-30 Christopher P. Chambers , Federico Echenique , Nicolas S. Lambert

Although many investigators affirm a desire to build reasoning systems that behave consistently with the axiomatic basis defined by probability theory and utility theory, limited resources for engineering and computation can make a complete…

Artificial Intelligence · Computer Science 2013-04-11 Eric J. Horvitz

An important use of machine learning is to learn what people value. What posts or photos should a user be shown? Which jobs or activities would a person find rewarding? In each case, observations of people's past choices can inform our…

Artificial Intelligence · Computer Science 2015-12-21 Owain Evans , Andreas Stuhlmueller , Noah D. Goodman

In machine learning or scientific computing, model performance is measured with an objective function. But why choose one objective over another? Information theory gives one answer: To maximize the information in the model, select the…

Machine Learning · Computer Science 2024-06-05 Timothy O. Hodson , Thomas M. Over , Tyler J. Smith , Lucy M. Marshall

Self-assessment rules play an essential role in safe and effective real-world robotic applications, which verify the feasibility of the selected action before actual execution. But how to utilize the self-assessment results to re-choose…

Robotics · Computer Science 2023-02-28 Kechun Xu , Runjian Chen , Shuqi Zhao , Zizhang Li , Hongxiang Yu , Ci Chen , Yue Wang , Rong Xiong

Dynamic treatment regimes or policies are a sequence of decision functions over multiple stages that are tailored to individual features. One important class of treatment policies in practice, namely multi-stage stationary treatment…

Machine Learning · Statistics 2025-01-09 Daiqi Gao , Yufeng Liu , Donglin Zeng

We study the consumption behaviour of an asymmetric network of heterogeneous agents in the framework of discrete choice models with stochastic decision rules. We assume that the interactions among agents are uniquely specified by their…

Disordered Systems and Neural Networks · Physics 2007-05-23 Giulia Iori , Vassilis Koulovassilopoulos

We introduce a new cost function over experiments, f-information, based on the theory of multivariate statistical divergences, that generalizes Sims's classic model of rational inattention as well as the class of posterior-separable cost…

Theoretical Economics · Economics 2025-10-07 Alex Bloedel , Tommaso Denti , Luciano Pomatto

Consider a setting in which a policy maker assigns subjects to treatments, observing each outcome before the next subject arrives. Initially, it is unknown which treatment is best, but the sequential nature of the problem permits learning…

Econometrics · Economics 2020-08-13 Anders Bredahl Kock , David Preinerstorfer , Bezirgen Veliyev

Estimating heterogeneous treatment effects is central to data-driven decision-making, yet industrial applications often face a fundamental tension between limited randomized controlled trial (RCT) budgets and abundant but biased…

Offline policy optimization could have a large impact on many real-world decision-making problems, as online learning may be infeasible in many applications. Importance sampling and its variants are a commonly used type of estimator in…

Machine Learning · Computer Science 2022-07-05 Yao Liu , Yannis Flet-Berliac , Emma Brunskill

This survey reviews recent developments in revealed preference theory. It discusses the testable implications of theories of choice that are germane to specific economic environments. The focus is on expected utility in risky environments;…

Theoretical Economics · Economics 2019-12-04 Federico Echenique

We study the problem of a decision maker who must provide the best possible treatment recommendation based on an experiment. The desirability of the outcome distribution resulting from the policy recommendation is measured through a…

Econometrics · Economics 2022-04-06 Anders Bredahl Kock , David Preinerstorfer , Bezirgen Veliyev

A voting rule decides on a probability distribution over a set of m alternatives, based on rankings of those alternatives provided by agents. We assume that agents have cardinal utility functions over the alternatives, but voting rules have…

Computer Science and Game Theory · Computer Science 2024-01-23 Soroush Ebadian , Anson Kahng , Dominik Peters , Nisarg Shah

Quantifying the impact of regulatory policies on social welfare generally requires the identification of counterfactual distributions. Many of these policies (e.g. minimum wages or minimum working time) generate mass points and/or…

Econometrics · Economics 2025-11-25 Dalia Ghanem , Désiré Kédagni , Ismael Mourifié

This study proposes an end-to-end algorithm for policy learning in causal inference. We observe data consisting of covariates, treatment assignments, and outcomes, where only the outcome corresponding to the assigned treatment is observed.…

Econometrics · Economics 2025-12-30 Masahiro Kato

We study worst-case guarantees on the expected return of fixed-dataset policy optimization algorithms. Our core contribution is a unified conceptual and mathematical framework for the study of algorithms in this regime. This analysis…

Artificial Intelligence · Computer Science 2020-12-01 Jacob Buckman , Carles Gelada , Marc G. Bellemare

Data selection has emerged as a crucial downstream application of data valuation. While existing data valuation methods have shown promise in selection tasks, the theoretical foundations and full potential of using data values for selection…

Artificial Intelligence · Computer Science 2025-02-10 Hongliang Chi , Qiong Wu , Zhengyi Zhou , Jonathan Light , Emily Dodwell , Yao Ma

Synthetic data algorithms are widely employed in industries to generate artificial data for downstream learning tasks. While existing research primarily focuses on empirically evaluating utility of synthetic data, its theoretical…

Machine Learning · Statistics 2025-04-04 Shirong Xu , Will Wei Sun , Guang Cheng

Transfer learning of prediction models has been extensively studied, while the corresponding policy learning approaches are rarely discussed. In this paper, we propose principled approaches for learning the optimal policy in the target…

Machine Learning · Computer Science 2025-05-20 Xueqing Liu , Qinwei Yang , Zhaoqing Tian , Ruocheng Guo , Peng Wu