English
Related papers

Related papers: Does GPT-4 pass the Turing test?

200 papers

Vision Language Models (VLMs) have demonstrated strong reasoning capabilities in Visual Question Answering (VQA) tasks; however, their ability to perform Theory of Mind (ToM) tasks, such as inferring human intentions, beliefs, and mental…

Computer Vision and Pattern Recognition · Computer Science 2025-04-25 Ximing Wen , Mallika Mainali , Anik Sen

Appraisal theories suggest that emotions arise from subjective evaluations of events, referred to as appraisals. The taxonomy of appraisals is quite diverse, and they are usually given ratings on a Likert scale to be annotated in an…

Computation and Language · Computer Science 2025-03-25 Deniss Ruder , Andero Uusberg , Kairit Sirts

ChatGPT is notorious for its intransparent behavior. This paper tries to shed light on this, providing an in-depth analysis of the dark personality traits and conspiracy beliefs of GPT-3.5 and GPT-4. Different psychological tests and…

Computation and Language · Computer Science 2024-02-07 Erik Weber , Jérôme Rutinowski , Markus Pauly

This study evaluates the performance of ChatGPT variants, GPT-3.5 and GPT-4, both with and without prompt engineering, against solely student work and a mixed category containing both student and GPT-4 contributions in university-level…

Computation and Language · Computer Science 2024-10-08 Will Yeadon , Alex Peach , Craig P. Testrow

This study investigates the capacity of Large Language Models (LLMs) to infer the Big Five personality traits from free-form user interactions. The results demonstrate that a chatbot powered by GPT-4 can infer personality with moderate…

Human-Computer Interaction · Computer Science 2024-05-24 Heinrich Peters , Moran Cerf , Sandra C. Matz

We propose an alternative to the Turing test that removes the inherent asymmetry between humans and machines in Turing's original imitation game. In this new test, both humans and machines judge each other. We argue that this makes the test…

Artificial Intelligence · Computer Science 2022-05-12 Toby Walsh

Large language models (LLMs) have been shown to be persuasive across a variety of contexts. But it remains unclear whether this persuasive power advantages truth over falsehood, or if LLMs can promote misbeliefs just as easily as refuting…

Large language models (LLMs) are now highly capable at a diverse range of tasks. This paper studies whether or not GPT-4, one such LLM, is capable of assisting researchers in the field of adversarial machine learning. As a case study, we…

Cryptography and Security · Computer Science 2023-07-28 Nicholas Carlini

This study evaluates the performance of large language models (LLMs) and the HINT model in predicting clinical trial outcomes, focusing on metrics including Balanced Accuracy, Matthews Correlation Coefficient (MCC), Recall, and Specificity.…

Machine Learning · Computer Science 2025-03-19 Shuyi Jin , Lu Chen , Hongru Ding , Meijie Wang , Lun Yu

Recent advancements in natural language processing by large language models (LLMs), such as GPT-4, have been suggested to approach Artificial General Intelligence. And yet, it is still under dispute whether LLMs possess similar reasoning…

Computation and Language · Computer Science 2024-02-02 Eugenio Herrera-Berg , Tomás Vergara Browne , Pablo León-Villagrá , Marc-Lluís Vives , Cristian Buc Calderon

Large language models (LLMs) are currently at the forefront of intertwining AI systems with human communication and everyday life. Therefore, it is of great importance to evaluate their emerging abilities. In this study, we show that LLMs…

Computation and Language · Computer Science 2023-10-10 Thilo Hagendorff , Sarah Fabi , Michal Kosinski

This paper investigates the emotional reasoning abilities of the GPT family of large language models via a component perspective. The paper first examines how the model reasons about autobiographical memories. Second, it systematically…

Computation and Language · Computer Science 2023-07-27 Ala N. Tak , Jonathan Gratch

The rapid evolution of artificial intelligence (AI), especially in the domain of Large Language Models (LLMs) and generative AI, has opened new avenues for application across various fields, yet its role in business education remains…

Computation and Language · Computer Science 2024-01-09 Vahid Ashrafimoghari , Necdet Gürkan , Jordan W. Suchow

GPT-3 and GPT-4 models are powerful, achieving high performance on a variety of Natural Language Processing tasks. However, there is a relative lack of detailed published analysis of their performance on the task of grammatical error…

Computation and Language · Computer Science 2023-05-31 Steven Coyne , Keisuke Sakaguchi , Diana Galvan-Sosa , Michael Zock , Kentaro Inui

Large language models (LLMs) have become mainstream technology with their versatile use cases and impressive performance. Despite the countless out-of-the-box applications, LLMs are still not reliable. A lot of work is being done to improve…

Computation and Language · Computer Science 2023-06-13 Aisha Khatun , Daniel G. Brown

The present study aims to explore the capabilities of Language Models (LMs) in tackling high-stakes multiple-choice tests, represented here by the Exame Nacional do Ensino M\'edio (ENEM), a multidisciplinary entrance examination widely…

Computation and Language · Computer Science 2023-03-31 Desnes Nunes , Ricardo Primi , Ramon Pires , Roberto Lotufo , Rodrigo Nogueira

The purpose of this paper is to analyse the opacity of algorithms, contextualized in the open debate on responsibility for artificial intelligence causation; with an experimental approach by which, applying the proposed conversational…

Artificial Intelligence · Computer Science 2025-01-24 Vincenzo Calderonio

Large Language Models (LLMs) show emergent patterns that mimic human cognition. We explore whether they also mirror other, less deliberative human psychological processes. Drawing upon classical theories of cognitive consistency, two…

Computers and Society · Computer Science 2025-02-12 Steven A. Lehr , Ketan S. Saichandran , Eddie Harmon-Jones , Nykko Vitali , Mahzarin R. Banaji

We investigate whether Large Language Models (LLMs) exhibit human-like cognitive patterns under four established frameworks from psychology: Thematic Apperception Test (TAT), Framing Bias, Moral Foundations Theory (MFT), and Cognitive…

Artificial Intelligence · Computer Science 2025-12-12 Akash Kundu , Rishika Goswami

In this study, we investigate the capabilities and inherent biases of advanced large language models (LLMs) such as GPT-3.5 and GPT-4 in the context of debate evaluation. We discover that LLM's performance exceeds humans and surpasses the…

Computation and Language · Computer Science 2024-06-05 Xinyi Liu , Pinxin Liu , Hangfeng He