English
Related papers

Related papers: Maia-2: A Unified Model for Human-AI Alignment in …

200 papers

Humans increasingly interact with Artificial intelligence(AI) systems. AI systems are optimized for objectives such as minimum computation or minimum error rate in recognizing and interpreting inputs from humans. In contrast, inputs created…

Machine Learning · Computer Science 2020-03-11 Johannes Schneider

We seek measurable properties of AI agents that make them better or worse teammates from the subjective perspective of human collaborators. Our experiments use the cooperative card game Hanabi -- a common benchmark for AI-teaming research.…

Human-Computer Interaction · Computer Science 2025-03-21 Ho Chit Siu , Jaime D. Peña , Yutai Zhou , Ross E. Allen

Existing approaches to algorithmic fairness aim to ensure equitable outcomes if human decision-makers comply perfectly with algorithmic decisions. However, perfect compliance with the algorithm is rarely a reality or even a desirable…

Machine Learning · Computer Science 2025-07-01 Haosen Ge , Hamsa Bastani , Osbert Bastani

According to cognitive psychology and related disciplines, the development of complex problem-solving behaviour in biological agents depends on hierarchical cognitive mechanisms. Hierarchical reinforcement learning is a promising…

Artificial Intelligence · Computer Science 2022-08-19 Manfred Eppe , Christian Gumbsch , Matthias Kerzel , Phuong D. H. Nguyen , Martin V. Butz , Stefan Wermter

The concepts of ``human-centered AI'' and ``value-based decision'' have gained significant attention in both research and industry. However, many critical aspects remain underexplored and require further investigation. In particular, there…

Artificial Intelligence · Computer Science 2025-08-26 Sz-Ting Tzeng , Frank Dignum

Discussion of AI alignment (alignment between humans and AI systems) has focused on value alignment, broadly referring to creating AI systems that share human values. We argue that before we can even attempt to align values, it is…

Machine Learning · Computer Science 2024-01-18 Sunayana Rane , Polyphony J. Bruna , Ilia Sucholutsky , Christopher Kello , Thomas L. Griffiths

While large language models have made strides in natural language processing, their proficiency in complex reasoning tasks requiring formal language comprehension, such as chess, remains less investigated. This paper probes the performance…

Computation and Language · Computer Science 2023-08-30 Mu-Tien Kuo , Chih-Chung Hsueh , Richard Tzong-Han Tsai

The AI alignment problem, which focusses on ensuring that artificial intelligence (AI), including AGI and ASI, systems act according to human values, presents profound challenges. With the progression from narrow AI to Artificial General…

Artificial Intelligence · Computer Science 2025-07-25 Alberto Hernández-Espinosa , Felipe S. Abrahão , Olaf Witkowski , Hector Zenil

Conversational human-likeness plays a central role in human-AI interaction, yet it has remained difficult to define, measure, and optimize. As a result, improvements in human-like behavior are largely driven by scale or broad supervised…

Artificial Intelligence · Computer Science 2026-01-08 Masum Hasan , Junjie Zhao , Ehsan Hoque

As artificial intelligence (AI) improves, traditional alignment strategies may falter in the face of unpredictable self-improvement, hidden subgoals, and the sheer complexity of intelligent systems. Inspired by contemplative wisdom…

Artificial Intelligence · Computer Science 2025-08-19 Ruben Laukkonen , Fionn Inglis , Shamil Chandaria , Lars Sandved-Smith , Edmundo Lopez-Sola , Jakob Hohwy , Jonathan Gold , Adam Elwood

Serious games are widely used for learning and training across domains such as healthcare, defense, and education. Persistent challenges remain, however, including static scenario design, authoring bottlenecks, limited learner modeling, and…

Artificial Intelligence · Computer Science 2026-05-22 Priyamvada Tripathi , Bill Kapralos

Productive human-AI collaboration requires appropriate reliance, yet contemporary AI systems are often miscalibrated, exhibiting systematic overconfidence or underconfidence. We investigate whether humans can learn to mentally recalibrate…

Human-Computer Interaction · Computer Science 2026-03-25 ZhaoBin Li , Mark Steyvers

This report presents Giraffe, a chess engine that uses self-play to discover all its domain-specific knowledge, with minimal hand-crafted knowledge given by the programmer. Unlike previous attempts using machine learning only to perform…

Artificial Intelligence · Computer Science 2015-09-15 Matthew Lai

With large chess-playing neural network models like AlphaZero contesting the state of the art within the world of computerised chess, two challenges present themselves: The question of how to explain the domain knowledge internalised by…

Machine Learning · Computer Science 2023-09-19 Patrik Hammersborg , Inga Strümke

As Artificial Intelligence (AI) technologies continue to advance, protecting human autonomy and promoting ethical decision-making are essential to fostering trust and accountability. Human agency (the capacity of individuals to make…

Computers and Society · Computer Science 2025-10-13 Laxmiraju Kandikatla , Branislav Radeljic

When humans are subject to an algorithmic decision system, they can strategically adjust their behavior accordingly (``game'' the system). While a growing line of literature on strategic classification has used game-theoretic modeling to…

Machine Learning · Computer Science 2024-10-28 Raman Ebrahimi , Kristen Vaccaro , Parinaz Naghizadeh

Alignment of artificial intelligence (AI) encompasses the normative problem of specifying how AI systems should act and the technical problem of ensuring AI systems comply with those specifications. To date, AI alignment has generally…

Collaborative problem solving and learning are shaped by who or what is on the team. As large language models (LLMs) increasingly function as collaborators rather than tools, a key question is whether AI teammates can be aligned to express…

Human-Computer Interaction · Computer Science 2026-03-03 Mohammad Amin Samadi , Nia Nixon

We present an end-to-end learning method for chess, relying on deep neural networks. Without any a priori knowledge, in particular without any knowledge regarding the rules of chess, a deep neural network is trained using a combination of…

Neural and Evolutionary Computing · Computer Science 2017-11-28 Eli David , Nathan S. Netanyahu , Lior Wolf

We develop a network of Bayesian agents that collectively model the mental states of teammates from the observed communication. Using a generative computational approach to cognition, we make two contributions. First, we show that our agent…

Human-Computer Interaction · Computer Science 2023-03-29 Samuel Westby , Christoph Riedl