English
Related papers

Related papers: Off-Switching Not Guaranteed

200 papers

In large systems, it is important for agents to learn to act effectively, but sophisticated multi-agent learning algorithms generally do not scale. An alternative approach is to find restricted classes of games where simple, efficient…

Multiagent Systems · Computer Science 2009-03-16 Ian A. Kash , Eric J. Friedman , Joseph Y. Halpern

As artificial intelligence systems become increasingly agentic, capable of general reasoning, planning, and value prioritization, current safety practices that treat obedience as a proxy for ethical behavior are becoming inadequate. This…

Artificial Intelligence · Computer Science 2025-07-04 Joseph Boland

The AI model has surpassed human players in the game of Go, and it is widely believed that the AI model has encoded new knowledge about the Go game beyond human players. In this way, explaining the knowledge encoded by the AI model and…

Artificial Intelligence · Computer Science 2023-10-17 Huilin Zhou , Huijie Tang , Mingjie Li , Hao Zhang , Zhenyu Liu , Quanshi Zhang

Recent advances in artificial intelligence have been strongly driven by the use of game environments for training and evaluating agents. Games are often accessible and versatile, with well-defined state-transitions and goals allowing for…

Machine Learning · Computer Science 2019-09-19 Benjamin Beyret , José Hernández-Orallo , Lucy Cheke , Marta Halina , Murray Shanahan , Matthew Crosby

Machine Learning algorithms are technological key enablers for artificial intelligence (AI). Due to the inherent complexity, these learning algorithms represent black boxes and are difficult to comprehend, therefore influencing compliance…

Computers and Society · Computer Science 2020-02-21 NIklas Kuhl , Jodie Lobana , Christian Meske

The collaboration between humans and artificial intelligence (AI) holds the promise of achieving superior outcomes compared to either acting alone-a phenomenon called human-AI synergy. Nevertheless, our understanding of the conditions that…

In the last few decades, numerous experiments have shown that humans do not always behave so as to maximize their material payoff. Cooperative behavior when non-cooperation is a dominant strategy (with respect to the material payoffs) is…

Computer Science and Game Theory · Computer Science 2014-11-05 Valerio Capraro , Joseph Y. Halpern

Learning theories have historically changed when the conditions of learning evolved. Generative and agentic AI create a new condition by allowing learners to delegate explanation, writing, problem solving, and other cognitive work to…

Artificial Intelligence · Computer Science 2026-05-25 Lixiang Yan , Dragan Gašević

Across a growing number of domains, human experts are expected to learn from and adapt to AI with superior decision making abilities. But how can we quantify such human adaptation to AI? We develop a simple measure of human adaptation to AI…

Human-Computer Interaction · Computer Science 2021-02-02 Minkyu Shin , Jin Kim , Minkyung Kim

A longstanding goal of artificial intelligence is to create artificial agents capable of learning to perform tasks that require sequential decision making. Importantly, while it is the artificial agent that learns and acts, it is still up…

Artificial Intelligence · Computer Science 2021-07-14 Ruohan Zhang , Faraz Torabi , Garrett Warnell , Peter Stone

As algorithmic tools increasingly aid experts in making consequential decisions, the need to understand the precise factors that mediate their influence has grown commensurately. In this paper, we present a crowdsourcing vignette study…

Human-Computer Interaction · Computer Science 2022-05-20 Riccardo Fogliato , Sina Fazelpour , Shantanu Gupta , Zachary Lipton , David Danks

AI and ML models have already found many applications in critical domains, such as healthcare and criminal justice. However, fully automating such high-stakes applications can raise ethical or fairness concerns. Instead, in such cases,…

Artificial Intelligence · Computer Science 2023-04-28 Ioannis Papantonis , Vaishak Belle

Previous research on expert advice-taking shows that humans exhibit two contradictory behaviors: on the one hand, people tend to overvalue their own opinions undervaluing the expert opinion, and on the other, people often defer to other…

Computation and Language · Computer Science 2023-10-24 Elena Sergeeva , Anastasia Sergeeva , Huiyun Tang , Kerstin Bongard-Blanchy , Peter Szolovits

How to detect and mitigate deceptive AI systems is an open problem for the field of safe and trustworthy AI. We analyse two algorithms for mitigating deception: The first is based on the path-specific objectives framework where paths in the…

Artificial Intelligence · Computer Science 2023-06-27 Ismail Sahbane , Francis Rhys Ward , C Henrik Åslund

As interactions between humans and AI become more prevalent, it is critical to have better predictors of human behavior in these interactions. We investigated how changes in the AI's adaptive algorithm impact behavior predictions in…

Artificial Intelligence · Computer Science 2024-08-28 Jason T. Isa , Bohan Wu , Qirui Wang , Yilin Zhang , Samuel A. Burden , Lillian J. Ratliff , Benjamin J. Chasnov

Many real-life scenarios require humans to make difficult trade-offs: do we always follow all the traffic rules or do we violate the speed limit in an emergency? These scenarios force us to evaluate the trade-off between collective norms…

Artificial Intelligence · Computer Science 2021-09-24 Arie Glazier , Andrea Loreggia , Nicholas Mattei , Taher Rahgooy , Francesca Rossi , K. Brent Venable

Human interactions are influenced by emotions, temperament, and affection, often conflicting with individuals' underlying preferences. Without explicit knowledge of those preferences, judging whether behaviour is appropriate becomes…

Computer Science and Game Theory · Computer Science 2025-11-05 Victor Villin , Christos Dimitrakakis

Collaborative decision-making with artificial intelligence (AI) agents presents opportunities and challenges. While human-AI performance often surpasses that of individuals, the impact of such technology on human behavior remains…

Artificial Intelligence · Computer Science 2024-11-18 Marco Matarese , Francesco Rea , Katharina J. Rohlfing , Alessandra Sciutti

AI agents are increasingly deployed in ecosystems where they repeatedly interact not only with each other but also with humans. In this work, we study these human-AI ecosystems from a theoretical perspective, focusing on the classical…

Machine Learning · Computer Science 2025-12-01 Natalie Collina , Eshwar Ram Arunachaleswaran , Meena Jagadeesan

The act of bluffing confounds game designers to this day. The very nature of bluffing is even open for debate, adding further complication to the process of creating intelligent virtual players that can bluff, and hence play, realistically.…

Artificial Intelligence · Computer Science 2007-05-23 Evan Hurwitz , Tshilidzi Marwala