English
Related papers

Related papers: The Turing Test Is More Relevant Than Ever

200 papers

A recent advance in computer technology has permitted scientists to implement and test algorithms that were known from quite some time (or not) but which were computationally expensive. Two such projects are IBM's Jeopardy as a part of its…

Computation and Language · Computer Science 2012-08-21 Nishal Pradeepkumar Shah

In this paper, we report our experience with ``TuringHotel'', a novel extension of the Turing Test based on interactions within mixed communities of Large Language Models (LLMs) and human participants. The classical one-to-one interaction…

Machine Learning · Computer Science 2026-03-20 Christian Di Maio , Tommaso Guidi , Luigi Quarantiello , Jack Bell , Marco Gori , Stefano Melacci , Vincenzo Lomonaco

Large Language Models based on transformer algorithms have revolutionized Artificial Intelligence by enabling verbal interaction with machines akin to human conversation. These AI agents have surpassed the Turing Test, achieving confusion…

This study aims to evaluate machine intelligence through artistic creativity by employing a modified version of the Turing Test inspired by Lady Lovelace. It investigates two hypotheses: whether human judges can reliably distinguish…

Computers and Society · Computer Science 2025-09-16 Ewelina Gajewska

This paper critically examines the recent publication "ChatGPT-4 in the Turing Test" by Restrepo Echavarr\'ia (2025), challenging its central claims regarding the absence of minimally serious test implementations and the conclusion that…

Artificial Intelligence · Computer Science 2025-12-30 Marco Giunti

We discuss the adequacy of tests for intelligent systems and practical problems raised by their implementation. We propose the replacement test as the ability of a system to replace successfully another system performing a task in a given…

Artificial Intelligence · Computer Science 2023-08-15 Joseph Sifakis

We propose an alternative to the Turing test that removes the inherent asymmetry between humans and machines in Turing's original imitation game. In this new test, both humans and machines judge each other. We argue that this makes the test…

Artificial Intelligence · Computer Science 2022-05-12 Toby Walsh

A central goal of explainable artificial intelligence (XAI) is to improve the trust relationship in human-AI interaction. One assumption underlying research in transparent AI systems is that explanations help to better assess predictions of…

Artificial Intelligence · Computer Science 2021-06-23 Felix Biessmann , Viktor Treu

Large Language Models (LLMs) have demonstrated remarkable human-like capabilities, yet their ability to replicate a specific individual remains under-explored. This paper presents a case study to investigate LLM-based individual simulation…

Computation and Language · Computer Science 2026-03-03 Minghao Guo , Ziyi Ye , Wujiang Xu , Xi Zhu , Wenyue Hua , Dimitris N. Metaxas

We survey concepts at the frontier of research connecting artificial, animal and human cognition to computation and information processing---from the Turing test to Searle's Chinese Room argument, from Integrated Information Theory to…

Artificial Intelligence · Computer Science 2015-12-25 Nicolas Gauvrit , Hector Zenil , Jesper Tegnér

Large Language Models (LLMs) have achieved remarkable results on a range of standardized tests originally designed to assess human cognitive and psychological traits, such as intelligence and personality. While these results are often…

Machine Learning · Computer Science 2026-05-12 Tom Sühr , Florian E. Dorner , Olawale Salaudeen , Augustin Kelava , Samira Samadi

Although the definition and measurement of intelligence is clearly of fundamental importance to the field of artificial intelligence, no general survey of definitions and tests of machine intelligence exists. Indeed few researchers are even…

Artificial Intelligence · Computer Science 2008-06-26 Shane Legg , Marcus Hutter

In the burgeoning field of artificial intelligence (AI), the unprecedented progress of large language models (LLMs) in natural language processing (NLP) offers an opportunity to revisit the entire approach of traditional metrics of machine…

Computation and Language · Computer Science 2023-10-06 Patricio Vera , Pedro Moya , Lisa Barraza

Generative AI techniques have opened the path for new generations of machines in diverse domains. These machines have various capabilities for example, they can produce images, generate answers or stories, and write codes based on the…

Artificial Intelligence · Computer Science 2023-07-18 Nitisha Aggarwal , Geetika Jain Saxena , Sanjeev Singh , Amit Pundir

Recent hype surrounding the increasing sophistication of language processing models has renewed optimism regarding machines achieving a human-like command of natural language. Research in the area of natural language understanding (NLU) in…

Computation and Language · Computer Science 2022-11-18 Lize Alberts

The role-play ability of Large Language Models (LLMs) has emerged as a popular research direction. However, existing studies focus on imitating well-known public figures or fictional characters, overlooking the potential for simulating…

Computation and Language · Computer Science 2024-04-23 Man Tik Ng , Hui Tung Tse , Jen-tse Huang , Jingjing Li , Wenxuan Wang , Michael R. Lyu

The goal of creating Artificial General Intelligence (AGI) -- or in other words of creating Turing machines (modern computers) that can behave in a way that mimics human intelligence -- has occupied AI researchers ever since the idea of AI…

Artificial Intelligence · Computer Science 2019-12-02 J. Landgrebe , B. Smith

The pursuit of human-like conversational agents has long been guided by the Turing test. For modern speech-to-speech (S2S) systems, a critical yet unanswered question is whether they can converse like humans. To tackle this, we conduct the…

Artificial Intelligence · Computer Science 2026-03-03 Xiang Li , Jiabao Gao , Sipei Lin , Xuan Zhou , Chi Zhang , Bo Cheng , Jiale Han , Benyou Wang

Since Alan Turing envisioned Artificial Intelligence (AI) [1], a major driving force behind technical progress has been competition with human cognition. Historical milestones have been frequently associated with computers matching or…

In this short note, we propose a unified framework that bridges three areas: (1) a flipped perspective on the Turing Test, the "dual Turing test", in which a human judge's goal is to identify an AI rather than reward a machine for…

Machine Learning · Computer Science 2025-07-23 Alberto Messina