English
Related papers

Related papers: Automatable Evaluation Method Oriented toward Beha…

200 papers

While Artificial Intelligence has successfully outperformed humans in complex combinatorial games (such as chess and checkers), humans have retained their supremacy in social interactions that require intuition and adaptation, such as…

Computers and Society · Computer Science 2014-04-22 Fatimah Ishowo-Oloko , Jacob Crandall , Manuel Cebrian , Sherief Abdallah , Iyad Rahwan

When deploying autonomous agents in the real world, we need effective ways of communicating objectives to them. Traditional skill learning has revolved around reinforcement and imitation learning, each with rigid constraints on the format…

Artificial Intelligence · Computer Science 2019-11-21 Mark Woodward , Chelsea Finn , Karol Hausman

Large language models (LLMs) are increasingly used to simulate human decision-making, but their intrinsic biases often diverge from real human behavior--limiting their ability to reflect population-level diversity. We address this challenge…

Computer Science and Game Theory · Computer Science 2025-08-27 Ayato Kitadai , Yusuke Fukasawa , Nariaki Nishino

Computer-use agents have rapidly improved on real-world tasks such as web navigation, desktop automation, and software interaction, in some cases surpassing human performance. Yet even when the task and model are unchanged, an agent that…

Artificial Intelligence · Computer Science 2026-04-21 Gonzalo Gonzalez-Pumariega , Saaket Agashe , Jiachen Yang , Ang Li , Xin Eric Wang

This position paper reflects empirical data collected during my PhD from a large-scale within-subjects study (N = 90). The study compared a highly human-like, spoken embodied conversational agent (ECA) against a low human-like text base…

Human-Computer Interaction · Computer Science 2026-05-28 Danai Korre

In order to have effective human-AI collaboration, it is necessary to address how the AI agent's behavior is being perceived by the humans-in-the-loop. When the agent's task plans are generated without such considerations, they may often…

Artificial Intelligence · Computer Science 2019-03-15 Anagha Kulkarni , Yantian Zha , Tathagata Chakraborti , Satya Gautam Vadlamudi , Yu Zhang , Subbarao Kambhampati

With increasing interest in procedural content generation by academia and game developers alike, it is vital that different approaches can be compared fairly. However, evaluating procedurally generated video game levels is often difficult,…

Artificial Intelligence · Computer Science 2024-10-28 Michael Beukman , Steven James , Christopher Cleghorn

The General Video Game AI competitions have been the testing ground for several techniques for game playing, such as evolutionary computation techniques, tree search algorithms, hyper heuristic based or knowledge based algorithms. So far…

Artificial Intelligence · Computer Science 2018-06-05 Ivan Bravi , Jialin Liu , Diego Perez-Liebana , Simon Lucas

As the complexity and scope of game development increase, playtesting remains an essential activity to ensure the quality of video games. Yet, the manual, ad-hoc nature of playtesting gives space to improvements in the process. In this…

Software Engineering · Computer Science 2022-03-14 Cristiano Politowski , Yann-Gaël Guéhéneuc , Fabio Petrillo

Despite the growing interest in collaborative AI, designing systems that seamlessly integrate human input remains a major challenge. In this study, we developed a task to systematically examine human preferences for collaborative agents. We…

Artificial Intelligence · Computer Science 2025-10-28 Lukas William Mayer , Sheer Karny , Jackie Ayoub , Miao Song , Danyang Tian , Ehsan Moradi-Pari , Mark Steyvers

This paper describes a method for generative player modeling and its application to the automatic testing of game content using archetypal player models called procedural personas. Theoretically grounded in psychological decision theory,…

Artificial Intelligence · Computer Science 2018-02-21 Christoffer Holmgård , Michael Cerny Green , Antonios Liapis , Julian Togelius

We argue that 3-D first-person video games are a challenging environment for real-time multi-modal reasoning. We first describe our dataset of human game-play, collected across a large variety of 3-D first-person games, which is both…

Machine Learning · Computer Science 2025-10-21 Yuguang Yue , Irakli Salia , Samuel Hunt , Christopher Green , Wenzhe Shi , Jonathan J Hunt

The maturation of cognition, from introspection to understanding others, has long been a hallmark of human development. This position paper posits that for AI systems to truly emulate or approach human-like interactions, especially within…

Multiagent Systems · Computer Science 2023-12-19 Jasmine A. Berry

Understanding how an individual changes its attitude, belief, and opinion due to other people's social influences is vital because of its wide implications. A core methodology that is used to study the change of attitude under social…

Social and Information Networks · Computer Science 2023-06-07 Yun-Shiuan Chuang , Timothy T. Rogers

When humans are subject to an algorithmic decision system, they can strategically adjust their behavior accordingly (``game'' the system). While a growing line of literature on strategic classification has used game-theoretic modeling to…

Machine Learning · Computer Science 2024-10-28 Raman Ebrahimi , Kristen Vaccaro , Parinaz Naghizadeh

As AI systems are increasingly involved in decision making, it also becomes important that they elicit appropriate levels of trust from their users. To achieve this, it is first important to understand which factors influence trust in AI.…

Artificial Intelligence · Computer Science 2021-05-20 Siddharth Mehrotra , Catholijn M. Jonker , Myrthe L. Tielman

Evolutionary game theory is a successful mathematical framework geared towards understanding the selective pressures that affect the evolution of the strategies of agents engaged in interactions with potential conflicts. While a…

Populations and Evolution · Quantitative Biology 2016-09-01 Christoph Adami , Jory Schossau , Arend Hintze

The key for effective interaction in many multiagent applications is to reason explicitly about the behaviour of other agents, in the form of a hypothesised behaviour. While there exist several methods for the construction of a behavioural…

Multiagent Systems · Computer Science 2019-07-04 Stefano V. Albrecht , S. Ramamoorthy

Trust is a crucial component in collaborative multiagent systems (MAS) involving humans and autonomous AI agents. Rather than assuming trust based on past system behaviours, it is important to formally verify trust by modelling the current…

Computer Science and Game Theory · Computer Science 2023-11-17 Asieh Salehi Fathabadi , Vahid Yazdanpanah

Large Language Models (LLMs) have shown remarkable promise in communicating with humans. Their potential use as artificial partners with humans in sociological experiments involving conversation is an exciting prospect. But how viable is…

Artificial Intelligence · Computer Science 2025-02-04 James Flamino , Mohammed Shahid Modi , Boleslaw K. Szymanski , Brendan Cross , Colton Mikolajczyk