English
Related papers

Related papers: Does GPT-4 pass the Turing test?

200 papers

We evaluated 3 systems (ELIZA, GPT-3.5 and GPT-4) in a randomized, controlled, and preregistered Turing test. Human participants had a 5 minute conversation with either a human or an AI, and judged whether or not they thought their…

Human-Computer Interaction · Computer Science 2024-05-15 Cameron R. Jones , Benjamin K. Bergen

We evaluated 4 systems (ELIZA, GPT-4o, LLaMa-3.1-405B, and GPT-4.5) in two randomised, controlled, and pre-registered Turing tests on independent populations. Participants had 5 minute conversations simultaneously with another human…

Computation and Language · Computer Science 2025-04-01 Cameron R. Jones , Benjamin K. Bergen

The current cycle of hype and anxiety concerning the benefits and risks to human society of Artificial Intelligence is fuelled, not only by the increasing use of generative AI and other AI tools by the general public, but also by claims…

Human-Computer Interaction · Computer Science 2025-01-30 Sharon Temtsin , Diane Proudfoot , David Kaber , Christoph Bartneck

This paper critically examines the recent publication "ChatGPT-4 in the Turing Test" by Restrepo Echavarr\'ia (2025), challenging its central claims regarding the absence of minimally serious test implementations and the conclusion that…

Artificial Intelligence · Computer Science 2025-12-30 Marco Giunti

The Turing Test, first proposed by Alan Turing in 1950, has historically served as a benchmark for evaluating artificial intelligence (AI). However, since the release of ELIZA in 1966, and particularly with recent advancements in large…

Human-Computer Interaction · Computer Science 2025-05-06 Avraham Rahimov , Orel Zamler , Amos Azaria

The role-play ability of Large Language Models (LLMs) has emerged as a popular research direction. However, existing studies focus on imitating well-known public figures or fictional characters, overlooking the potential for simulating…

Computation and Language · Computer Science 2024-04-23 Man Tik Ng , Hui Tung Tse , Jen-tse Huang , Jingjing Li , Wenxuan Wang , Michael R. Lyu

The development of advanced generative chat models, such as ChatGPT, has raised questions about the potential consciousness of these tools and the extent of their general artificial intelligence. ChatGPT consistent avoidance of passing the…

General Literature · Computer Science 2023-04-26 Arend Hintze

Advances in artificial intelligence (AI) raise important questions about whether people view moral evaluations by AI systems similarly to human-generated moral evaluations. We conducted a modified Moral Turing Test (m-MTT), inspired by…

Everyday AI detection requires differentiating between people and AI in informal, online conversations. In many cases, people will not interact directly with AI systems but instead read conversations between AI systems and other people. We…

Human-Computer Interaction · Computer Science 2024-07-15 Ishika Rathi , Sydney Taylor , Benjamin K. Bergen , Cameron R. Jones

We examine whether a leading AI system GPT4 understands text as well as humans do, first using a well-established standardized test of discourse comprehension. On this test, GPT4 performs slightly, but not statistically significantly,…

Computation and Language · Computer Science 2025-01-22 Thomas R. Shultz , Jamie M. Wise , Ardavan Salehi Nobandegani

As Large Language Models (LLMs) become increasingly integrated into everyday life as general purpose multimodal AI systems, their capabilities to simulate human understanding are under examination. This study investigates LLMs ability to…

Computation and Language · Computer Science 2025-08-26 Ljubisa Bojic , Predrag Kovacevic , Milan Cabarkapa

We subject GPT-4 to a number of rigorous psychometric tests and analyze the results. We find that, compared to the average human, GPT-4 tends to show more honesty and humility, and less machiavellianism and narcissism. It sometimes exhibits…

Computation and Language · Computer Science 2024-02-06 Adrita Barua , Gary Brase , Ke Dong , Pascal Hitzler , Eugene Vasserman

ChatGPT has gained a huge popularity since its introduction. Its positive aspects have been reported through many media platforms, and some analyses even showed that ChatGPT achieved a decent grade in professional exams, adding extra…

Computation and Language · Computer Science 2023-11-15 Myeongjun Erik Jang , Thomas Lukasiewicz

This study investigates the efficacy of large language models (LLMs) as tools for grading master-level student essays. Utilizing a sample of 60 essays in political science, the study compares the accuracy of grades suggested by the GPT-4…

General Economics · Economics 2024-06-25 Magnus Lundgren

Large language models (LLMs) are currently at the forefront of intertwining AI systems with human communication and everyday life. Therefore, it is of great importance to evaluate their emerging abilities. In this study, we show that LLMs,…

Computation and Language · Computer Science 2023-10-10 Thilo Hagendorff , Sarah Fabi

This paper proposes to revisit the Turing test through the concept of normality. Its core argument is that the Turing test is a test of normal intelligence as assessed by a normal judge. First, in the sense that the Turing test targets…

Computation and Language · Computer Science 2025-11-11 Alexandre Kabbach

The Turing test examines whether AIs exhibit human-like behaviour in natural language conversations. The traditional setting limits each participant to one message at a time and requires constant human participation. This fails to reflect a…

Computation and Language · Computer Science 2025-05-30 Weiqi Wu , Hongqiu Wu , Hai Zhao

We present "Human or Not?", an online game inspired by the Turing test, that measures the capability of AI chatbots to mimic humans in dialog, and of humans to tell bots from other humans. Over the course of a month, the game was played by…

Artificial Intelligence · Computer Science 2023-06-01 Daniel Jannai , Amos Meron , Barak Lenz , Yoav Levine , Yoav Shoham

Cognitive psychology delves on understanding perception, attention, memory, language, problem-solving, decision-making, and reasoning. Large language models (LLMs) are emerging as potent tools increasingly capable of performing human-level…

Computation and Language · Computer Science 2023-04-13 Sifatkaur Dhingra , Manmeet Singh , Vaisakh SB , Neetiraj Malviya , Sukhpal Singh Gill

The Turing Test (TT) checks for human intelligence, rather than any putative general intelligence. It involves repeated interaction requiring learning in the form of adaption to the human conversation partner. It is a macro-level post-hoc…

Artificial Intelligence · Computer Science 2012-10-10 Bruce Edmonds , Carlos Gershenson
‹ Prev 1 2 3 10 Next ›