English
Related papers

Related papers: Strategic Classification is Causal Modeling in Dis…

200 papers

Strategic classification studies the interaction between a classification rule and the strategic agents it governs. Under the assumption that the classifier is known, rational agents respond to it by manipulating their features. However, in…

Machine Learning · Computer Science 2021-06-15 Ganesh Ghalme , Vineet Nair , Itay Eilat , Inbal Talgam-Cohen , Nir Rosenfeld

Under the assumptions that (i) gamification consists of various types of users that experience game design elements differently; and (ii) gamification is deployed in order to achieve some goal in the broadest sense, we pose the gamification…

Human-Computer Interaction · Computer Science 2014-07-04 Michael Meder , Brijnesh-Johannes Jain

We investigate the problem of designing optimal classifiers in the strategic classification setting, where the classification is part of a game in which players can modify their features to attain a favorable classification outcome (while…

Machine Learning · Computer Science 2020-05-19 Mark Braverman , Sumegha Garg

We study reward design strategies for incentivizing a reinforcement learning agent to adopt a policy from a set of admissible policies. The goal of the reward designer is to modify the underlying reward function cost-efficiently while…

Machine Learning · Computer Science 2022-01-07 Kiarash Banihashem , Adish Singla , Jiarui Gan , Goran Radanovic

Learning policies via preference-based reward learning is an increasingly popular method for customizing agent behavior, but has been shown anecdotally to be prone to spurious correlations and reward hacking behaviors. While much prior work…

Machine Learning · Computer Science 2023-03-21 Jeremy Tien , Jerry Zhi-Yang He , Zackory Erickson , Anca D. Dragan , Daniel S. Brown

We apply control theoretic and optimization techniques to adaptively design incentives. In particular, we consider the problem of a planner with an objective that depends on data from strategic decision makers. The planner does not know the…

Computer Science and Game Theory · Computer Science 2018-06-18 Lillian J. Ratliff , Tanner Fiez

Imitation is a key component of human social behavior, and is widely used by both children and adults as a way to navigate uncertain or unfamiliar situations. But in an environment populated by multiple heterogeneous agents pursuing…

Neurons and Cognition · Quantitative Biology 2023-05-15 Max Taylor-Davies , Stephanie Droop , Christopher G. Lucas

The paper focuses on identifying the causes of student performance to provide personalized recommendations for improving pass rates. We introduce the need to move beyond predictive models and instead identify causal relationships. We…

Computers and Society · Computer Science 2023-09-26 Bevan I. Smith

In settings where Machine Learning (ML) algorithms automate or inform consequential decisions about people, individual decision subjects are often incentivized to strategically modify their observable attributes to receive more favorable…

Machine Learning · Computer Science 2022-06-10 Keegan Harris , Daniel Ngo , Logan Stapleton , Hoda Heidari , Zhiwei Steven Wu

Selective rationalization has become a common mechanism to ensure that predictive models reveal how they use any available features. The selection may be soft or hard, and identifies a subset of input features relevant for prediction. The…

Computation and Language · Computer Science 2019-12-17 Mo Yu , Shiyu Chang , Yang Zhang , Tommi S. Jaakkola

In contrast with standard classification tasks, strategic classification involves agents strategically modifying their features in an effort to receive favorable predictions. For instance, given a classifier determining loan approval based…

Machine Learning · Computer Science 2024-03-01 Lee Cohen , Yishay Mansour , Shay Moran , Han Shao

Causal games are probabilistic graphical models that enable causal queries to be answered in multi-agent settings. They extend causal Bayesian networks by specifying decision and utility variables to represent the agents' degrees of freedom…

Computer Science and Game Theory · Computer Science 2024-06-14 Manuj Mishra , James Fox , Michael Wooldridge

Reward design is a critical part of the application of reinforcement learning, the performance of which strongly depends on how well the reward signal frames the goal of the designer and how well the signal assesses progress in reaching…

Machine Learning · Computer Science 2022-08-01 Yixiang Wang , Yujing Hu , Feng Wu , Yingfeng Chen

Machine learning techniques can be useful in applications such as credit approval and college admission. However, to be classified more favorably in such contexts, an agent may decide to strategically withhold some of her features, such as…

Machine Learning · Computer Science 2021-01-15 Anilesh K. Krishnaswamy , Haoming Li , David Rein , Hanrui Zhang , Vincent Conitzer

Machine learning is the science of discovering statistical dependencies in data, and the use of those dependencies to perform predictions. During the last decade, machine learning has made spectacular progress, surpassing human performance…

Machine Learning · Statistics 2016-07-13 David Lopez-Paz

This paper studies the performative policy learning problem, where agents adjust their features in response to a released policy to improve their potential outcomes, inducing an endogenous distribution shift. There has been growing interest…

Machine Learning · Computer Science 2025-02-25 Qianyi Chen , Ying Chen , Bo Li

Why do reinforcement learning (RL) policies fail or succeed? This is a challenging question due to the complex, high-dimensional nature of agent-environment interactions. In this work, we take a causal perspective on explaining the behavior…

Machine Learning · Statistics 2025-07-22 Armin Kekić , Jan Schneider , Dieter Büchler , Bernhard Schölkopf , Michel Besserve

Overcoming the impact of selfish behavior of rational players in multiagent systems is a fundamental problem in game theory. Without any intervention from a central agent, strategic users take actions in order to maximize their personal…

Computer Science and Game Theory · Computer Science 2024-09-06 Maria-Florina Balcan , Matteo Pozzi , Dravyansh Sharma

Capability planning problems are pervasive throughout many areas of human interest with prominent examples found in defense and security. Planning provides a unique context for optimization that has not been explored in great detail and…

Neural and Evolutionary Computing · Computer Science 2009-07-03 James M. Whitacre , Hussein A. Abbass , Ruhul Sarker , Axel Bender , Stephen Baker

We reformulate explanation quality assessment as a ranking problem rather than a generation problem. Instead of optimizing models to produce a single "best" explanation token-by-token, we train reward models to discriminate among multiple…

Artificial Intelligence · Computer Science 2026-04-28 Thomas Bailleux , Tanmoy Mukherjee , Emmanuel Lonca , Pierre Marquis , Zied Bouraoui