English
Related papers

Related papers: MAD Chairs: A new tool to evaluate AI

200 papers

Artificial intelligence-based systems for player risk detection have become central to harm prevention efforts in the gambling industry. However, growing concerns around transparency and effectiveness have highlighted the absence of…

As generative AI increasingly outperforms students in producing academic writing, a critical question arises: how can we preserve the motivation, creativity, and intellectual growth of novice researchers in an age of automated academic…

Human-Computer Interaction · Computer Science 2025-10-28 Kenji Saito , Rei Tadika

Past work has sought to design AI ethics interventions--such as checklists or toolkits--to help practitioners design more ethical AI systems. However, other work demonstrates how these interventions may instead serve to limit critique to…

Computers and Society · Computer Science 2024-04-09 David Gray Widder , Laura Dabbish , James Herbsleb , Nikolas Martelaro

Although artificial intelligence (AI) shows growing promise for mental health care, current approaches to evaluating AI tools in this domain remain fragmented and poorly aligned with clinical practice, social context, and first-hand user…

Artificial intelligence (AI) systems are increasingly adopted as tool-using agents that can plan, observe their environment, and take actions over extended time periods. This evolution challenges current evaluation practices where the AI…

Cryptography and Security · Computer Science 2026-03-17 Simone Aonzo , Merve Sahin , Aurélien Francillon , Daniele Perito

The process of playtesting a game is subjective, expensive and incomplete. In this paper, we present a playtesting approach that explores the game space with automated agents and collects data to answer questions posed by the designers.…

Artificial Intelligence · Computer Science 2018-11-19 Fernando de Mesentier Silva , Igor Borovikov , John Kolen , Navid Aghdaie , Kazi Zaman

There are an increasing number of domains in which artificial intelligence (AI) systems both surpass human ability and accurately model human behavior. This introduces the possibility of algorithmically-informed teaching in these domains…

Artificial Intelligence · Computer Science 2024-11-04 Zhenwei Tang , Difan Jiao , Reid McIlroy-Young , Jon Kleinberg , Siddhartha Sen , Ashton Anderson

Serious games are widely used for learning and training across domains such as healthcare, defense, and education. Persistent challenges remain, however, including static scenario design, authoring bottlenecks, limited learner modeling, and…

Artificial Intelligence · Computer Science 2026-05-22 Priyamvada Tripathi , Bill Kapralos

Adding game elements to higher education is an increasingly common practice. As a result, many recent empirical studies focus on studying the effectiveness of gamified or game-based educational experiences. The findings of these studies are…

Computers and Society · Computer Science 2024-07-08 Giulio Barbero , Marcello M. Bonsangue , Felienne F. J. Hermans

In this article, we review recent Deep Learning advances in the context of how they have been applied to play different types of video games such as first-person shooters, arcade games, and real-time strategy games. We analyze the unique…

Artificial Intelligence · Computer Science 2019-02-19 Niels Justesen , Philip Bontrager , Julian Togelius , Sebastian Risi

Recent advances in artificial intelligence have been strongly driven by the use of game environments for training and evaluating agents. Games are often accessible and versatile, with well-defined state-transitions and goals allowing for…

Machine Learning · Computer Science 2019-09-19 Benjamin Beyret , José Hernández-Orallo , Lucy Cheke , Marta Halina , Murray Shanahan , Matthew Crosby

Competitor rating systems for head-to-head games are typically used to measure playing strength from game outcomes. Ratings computed from these systems are often used to select top competitors for elite events, for pairing players of…

Methodology · Statistics 2025-07-14 Mark E. Glickman

With the turmoil in cybersecurity and the mind-blowing advances in AI, it is only natural that cybersecurity practitioners consider further employing learning techniques to help secure their organizations and improve the efficiency of their…

Cryptography and Security · Computer Science 2019-12-17 Ricardo Morla

The rapid adoption of AI tools such as ChatGPT has significantly transformed academic practices, offering considerable benefits for both students and faculty in computing disciplines. These tools have been shown to enhance learning…

Computers and Society · Computer Science 2026-04-14 Hatem M. El-boghdadi , Toqeer Ali Syed , Ali Akarma , Qamar Wali

Recently, Artificial Intelligence (AI) technology use has been rising in sports to reach decisions of various complexity. At a relatively low complexity level, for example, major tennis tournaments replaced human line judges with Hawk-Eye…

Theoretical Economics · Economics 2024-07-19 Nejat Anbarci , Mehmet S. Ismail

If machine learning models were to achieve superhuman abilities at various reasoning or decision-making tasks, how would we go about evaluating such models, given that humans would necessarily be poor proxies for ground truth? In this…

Machine Learning · Computer Science 2023-10-20 Lukas Fluri , Daniel Paleka , Florian Tramèr

In recent years, there have been immense breakthroughs in Game AI research, particularly with Reinforcement Learning (RL). Despite their success, the underlying games are usually implemented with their own preset environments and game…

Artificial Intelligence · Computer Science 2022-07-14 Chris Bamford , Shengyi Huang , Simon Lucas

The use of Artificial Intelligence (AI) in high-risk, decision-making scenarios presents technical, safety, and normative challenges; problems that may only be ameliorated by human oversight. However, notions of human oversight lack a…

Machine ethics has received increasing attention over the past few years because of the need to ensure safe and reliable artificial intelligence (AI). The two dominantly used theories in machine ethics are deontological and utilitarian…

Artificial Intelligence · Computer Science 2023-01-10 Ajay Vishwanath , Einar Duenger Bøhn , Ole-Christoffer Granmo , Charl Maree , Christian Omlin

Artificial Intelligence (AI), with ChatGPT as a prominent example, has recently taken center stage in various domains including higher education, particularly in Computer Science and Engineering (CSE). The AI revolution brings both…

Computers and Society · Computer Science 2024-07-09 Zhangying He , Thomas Nguyen , Tahereh Miari , Mehrdad Aliasgari , Setareh Rafatirad , Hossein Sayadi