English
Related papers

Related papers: A Bandit Model for Human-Machine Decision Making w…

200 papers

Human decision-makers often face choices about complex cases with many potentially relevant features, but limited bandwidth to inspect and integrate all available information. In such settings, we study algorithms that highlight a small…

Computer Science and Game Theory · Computer Science 2026-04-27 Yifan Guo , Jann Spiess

When subjected to automated decision-making, decision subjects may strategically modify their observable features in ways they believe will maximize their chances of receiving a favorable decision. In many practical situations, the…

Computer Science and Game Theory · Computer Science 2022-10-10 Keegan Harris , Valerie Chen , Joon Sik Kim , Ameet Talwalkar , Hoda Heidari , Zhiwei Steven Wu

In many common interactive scenarios, participants lack information about other participants, and specifically about the preferences of other participants. In this work, we model an extreme case of incomplete information, which we term…

Computer Science and Game Theory · Computer Science 2016-11-04 Ilan Nehama

Modern machine learning models are opaque, and as a result there is a burgeoning academic subfield on methods that explain these models' behavior. However, what is the precise goal of providing such explanations, and how can we demonstrate…

Machine Learning · Computer Science 2022-12-01 Patrick Fernandes , Marcos Treviso , Danish Pruthi , André F. T. Martins , Graham Neubig

Decision-making with information displays is a key focus of research in areas like human-AI collaboration and data visualization. However, what constitutes a decision problem, and what is required for an experiment to conclude that…

Human-Computer Interaction · Computer Science 2025-05-05 Jessica Hullman , Alex Kale , Jason Hartline

Human decision-making deviates from the optimal solution, that maximizes cumulative rewards, in many situations. Here we approach this discrepancy from the perspective of bounded rationality and our goal is to provide a justification for…

Machine Learning · Computer Science 2019-05-13 Marcel Binz , Dominik Endres

The paper studies information-theoretic opacity, an information-flow privacy property, in a setting involving two agents: A planning agent who controls a stochastic system and an observer who partially observes the system states. The goal…

Systems and Control · Electrical Eng. & Systems 2024-11-20 Chongyang Shi , Yuheng Bu , Jie Fu

Many machine learning approaches are characterized by information constraints on how they interact with the training data. These include memory and sequential access constraints (e.g. fast first-order methods to solve stochastic…

Machine Learning · Computer Science 2014-10-29 Ohad Shamir

Information and free-energy maximization are physics principles that provide general rules for an agent to optimize actions in line with specific goals and policies. These principles are the building blocks for designing decision-making…

Machine Learning · Computer Science 2025-03-21 Alex Barbier-Chebbah , Christian L. Vestergaard , Jean-Baptiste Masson

We study the problem of online learning in Stackelberg games with side information between a leader and a sequence of followers. In every round the leader observes contextual information and commits to a mixed strategy, after which the…

Machine Learning · Computer Science 2026-05-05 Maria-Florina Balcan , Martino Bernasconi , Matteo Castiglioni , Andrea Celli , Keegan Harris , Zhiwei Steven Wu

Algorithms frequently assist, rather than replace, human decision-makers. However, the design and analysis of algorithms often focus on predicting outcomes and do not explicitly model their effect on human decisions. This discrepancy…

Human-Computer Interaction · Computer Science 2024-10-31 Bryce McLaughlin , Jann Spiess

Multi-objective multi-armed bandit (MO-MAB) problems traditionally aim to achieve Pareto optimality. However, real-world scenarios often involve users with varying preferences across objectives, resulting in a Pareto-optimal arm that may…

Machine Learning · Computer Science 2025-11-18 Linfeng Cao , Ming Shi , Ness B. Shroff

Sequential decision making under uncertainty is studied in a mixed observability domain. The goal is to maximize the amount of information obtained on a partially observable stochastic process under constraints imposed by a fully observable…

Artificial Intelligence · Computer Science 2016-03-16 Mikko Lauri , Risto Ritala

The task of learning to pick a single preferred example out a finite set of examples, an "optimal choice problem", is a supervised machine learning problem with complex, structured input. Problems of optimal choice emerge often in various…

Artificial Intelligence · Computer Science 2017-07-07 Marina Sapir

A robot operating in isolation needs to reason over the uncertainty in its model of the world and adapt its own actions to account for this uncertainty. Similarly, a robot interacting with people needs to reason over its uncertainty over…

Robotics · Computer Science 2017-08-07 Stefanos Nikolaidis , Jodi Forlizzi , David Hsu , Julie Shah , Siddhartha Srinivasa

We study the problem of repeated two-sided matching with uncertain preferences (two-sided bandits), and no explicit communication between agents. Recent work has developed algorithms that converge to stable matchings when one side (the…

Multiagent Systems · Computer Science 2025-08-13 Gaurab Pokharel , Sanmay Das

Continual data collection and widespread deployment of machine learning algorithms, particularly the distributed variants, have raised new privacy challenges. In a distributed machine learning scenario, the dataset is stored among several…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-12-16 Shripad Gade , Nitin H. Vaidya

Modeling the purposeful behavior of imperfect agents from a small number of observations is a challenging task. When restricted to the single-agent decision-theoretic setting, inverse optimal control techniques assume that observed behavior…

Computer Science and Game Theory · Computer Science 2013-08-19 Kevin Waugh , Brian D. Ziebart , J. Andrew Bagnell

Strategic classification studies the interaction between a classification rule and the strategic agents it governs. Under the assumption that the classifier is known, rational agents respond to it by manipulating their features. However, in…

Machine Learning · Computer Science 2021-06-15 Ganesh Ghalme , Vineet Nair , Itay Eilat , Inbal Talgam-Cohen , Nir Rosenfeld

Strategic information is valuable either by remaining private (for instance if it is sensitive) or, on the other hand, by being used publicly to increase some utility. These two objectives are antagonistic and leaking this information might…

Machine Learning · Statistics 2020-03-03 Etienne Boursier , Vianney Perchet