English
Related papers

Related papers: Learning In Reverse Causal Strategic Environments …

200 papers

We study systems of interacting reinforced stochastic processes, where agents' decisions evolve under reinforcement, network-mediated interactions, and environmental influences. In competitive environments with irreducible networks, we…

Probability · Mathematics 2025-09-18 Michele Aleandri , Paolo Dai Pra , Ida Germana Minelli

In many prediction problems, the predictive model affects the distribution of the prediction target. This phenomenon is known as performativity and is often caused by the behavior of individuals with vested interests in the outcome of the…

Machine Learning · Statistics 2024-06-03 Seamus Somerstep , Ya'acov Ritov , Yuekai Sun

Various methods for solving the inverse reinforcement learning (IRL) problem have been developed independently in machine learning and economics. In particular, the method of Maximum Causal Entropy IRL is based on the perspective of entropy…

Machine Learning · Computer Science 2021-03-05 Navyata Sanghvi , Shinnosuke Usami , Mohit Sharma , Joachim Groeger , Kris Kitani

Machine learning has grown in popularity to help assign resources and make decisions about users, which can result in discrimination. This includes hiring markets, where employers have increasingly been interested in using automated tools…

Computer Science and Game Theory · Computer Science 2024-12-20 Serafina Kamp , Benjamin Fish

A broad current application of algorithms is in formal and quantitative measures of murky concepts -- like merit -- to make decisions. When people strategically respond to these sorts of evaluations in order to gain favorable decision…

Computers and Society · Computer Science 2023-10-06 Benjamin Laufer , Jon Kleinberg , Karen Levy , Helen Nissenbaum

Equilibrium computation in markets usually considers settings where player valuation functions are known. We consider the setting where player valuations are unknown; using a PAC learning-theoretic framework, we analyze some classes of…

Computer Science and Game Theory · Computer Science 2021-09-10 Vignesh Viswanathan , Omer Lev , Neel Patel , Yair Zick

We enable reinforcement learning agents to learn successful behavior policies by utilizing relevant pre-existing teacher policies. The teacher policies are introduced as objectives, in addition to the task objective, in a multi-objective…

Machine Learning · Computer Science 2023-08-31 Shruti Mishra , Ankit Anand , Jordan Hoffmann , Nicolas Heess , Martin Riedmiller , Abbas Abdolmaleki , Doina Precup

Autonomous cyber-physical agents and systems play an increasingly large role in our lives. To ensure that agents behave in ways aligned with the values of the societies in which they operate, we must develop techniques that allow these…

In strategic classification, agents modify their features, at a cost, to ideally obtain a positive classification from the learner's classifier. The typical response of the learner is to carefully modify their classifier to be robust to…

Machine Learning · Computer Science 2024-02-15 Lee Cohen , Saeed Sharifi-Malvajerdi , Kevin Stangl , Ali Vakilian , Juba Ziani

It is evidence that representation learning can improve model's performance over multiple downstream tasks in many real-world scenarios, such as image classification and recommender systems. Existing learning approaches rely on establishing…

Machine Learning · Computer Science 2022-02-18 Mengyue Yang , Xinyu Cai , Furui Liu , Xu Chen , Zhitang Chen , Jianye Hao , Jun Wang

Many reinforcement learning (RL) environments consist of independent entities that interact sparsely. In such environments, RL agents have only limited influence over other entities in any particular situation. Our idea in this work is that…

Machine Learning · Computer Science 2021-12-03 Maximilian Seitzer , Bernhard Schölkopf , Georg Martius

Data bias, e.g., popularity impairs the dynamics of two-sided markets within recommender systems. This overshadows the less visible but potentially intriguing long-tail items that could capture user interest. Despite the abundance of…

Information Retrieval · Computer Science 2024-06-26 Zhichen Xiang , Hongke Zhao , Chuang Zhao , Ming He , Jianping Fan

We study misspecified Bayesian learning in principal-agent relationships, where an agent is assessed by an evaluator and rewarded by the market. The agent's outcome depends on their innate ability, costly effort -- whose effectiveness is…

Theoretical Economics · Economics 2025-12-02 Federico Echenique , Anqi Li

In dynamic settings each economic agent's choices can be revealing of her private information. This elicitation via the rationalization of observable behavior depends each agent's perception of which payoff-relevant contingencies other…

Theoretical Economics · Economics 2021-05-17 Evan Piermont , Peio Zuazo-Garin

Recent literature on computational notions of fairness has been broadly divided into two distinct camps, supporting interventions that address either individual-based or group-based fairness. Rather than privilege a single definition, we…

Computer Science and Game Theory · Computer Science 2017-07-07 Lily Hu , Yiling Chen

Why do reinforcement learning (RL) policies fail or succeed? This is a challenging question due to the complex, high-dimensional nature of agent-environment interactions. In this work, we take a causal perspective on explaining the behavior…

Machine Learning · Statistics 2025-07-22 Armin Kekić , Jan Schneider , Dieter Büchler , Bernhard Schölkopf , Michel Besserve

Assigning resources in business processes execution is a repetitive task that can be effectively automated. However, different automation methods may give varying results that may not be optimal. Proper resource allocation is crucial as it…

Machine Learning · Computer Science 2021-04-02 Kamil Żbikowski , Michał Ostapowicz , Piotr Gawrysiak

Automated decision-making tools increasingly assess individuals to determine if they qualify for high-stakes opportunities. A recent line of research investigates how strategic agents may respond to such scoring tools to receive favorable…

Machine Learning · Computer Science 2021-10-28 Keegan Harris , Hoda Heidari , Zhiwei Steven Wu

While LLMs exhibit impressive fluency and factual recall, they struggle with robust causal reasoning, often relying on spurious correlations and brittle patterns. Similarly, traditional Reinforcement Learning agents also lack causal…

Machine Learning · Computer Science 2025-09-26 Abi Aryan , Zac Liu

Methods for learning optimal policies in autonomous agents often assume that the way the domain is conceptualised---its possible states and actions and their causal structure---is known in advance and does not change during learning. This…

Artificial Intelligence · Computer Science 2018-01-11 Craig Innes , Alex Lascarides , Stefano V Albrecht , Subramanian Ramamoorthy , Benjamin Rosman