English
Related papers

Related papers: Bot or Human? Detecting ChatGPT Imposters with A S…

200 papers

Social media bot detection has always been an arms race between advancements in machine learning bot detectors and adversarial bot strategies to evade detection. In this work, we bring the arms race to the next level by investigating the…

Computation and Language · Computer Science 2024-07-08 Shangbin Feng , Herun Wan , Ningnan Wang , Zhaoxuan Tan , Minnan Luo , Yulia Tsvetkov

This study consists of qualitative empirical research, conducted through exploratory tests with two different Large Language Models (LLMs) chatbots: ChatGPT and Gemini. The methodological procedure involved exploratory tests based on…

Computation and Language · Computer Science 2024-07-19 Melise Peruchini , Julio Monteiro Teixeira

ChatGPT has the ability to generate grammatically flawless and seemingly-human replies to different types of questions from various domains. The number of its users and of its applications is growing at an unprecedented rate. Unfortunately,…

Computation and Language · Computer Science 2023-02-01 Sandra Mitrović , Davide Andreoletti , Omran Ayoub

With the development of generative models like GPT-3, it is increasingly more challenging to differentiate generated texts from human-written ones. There is a large number of studies that have demonstrated good results in bot…

Computation and Language · Computer Science 2023-11-21 Vasilii Gromov , Quynh Nhu Dang

Recent advances in large language models (LLMs) have led to the development of powerful AI chatbots capable of engaging in natural and human-like conversations. However, these chatbots can be potentially harmful, exhibiting manipulative,…

Artificial Intelligence · Computer Science 2023-04-04 Baihan Lin , Djallel Bouneffouf , Guillermo Cecchi , Kush R. Varshney

This study investigates the efficacy of large language models (LLMs) as tools for grading master-level student essays. Utilizing a sample of 60 essays in political science, the study compares the accuracy of grades suggested by the GPT-4…

General Economics · Economics 2024-06-25 Magnus Lundgren

A Large Language Model (LLM) is an artificial intelligence system that has been trained on vast amounts of natural language data, enabling it to generate human-like responses to written or spoken language input. GPT-3.5 is an example of an…

Artificial Intelligence · Computer Science 2023-05-09 Gaurav Suri , Lily R. Slater , Ali Ziaee , Morgan Nguyen

In Massively Multiplayer Online Role-Playing Games (MMORPGs), auto-leveling bots exploit automated programs to level up characters at scale, undermining gameplay balance and fairness. Detecting such bots is challenging, not only because…

Artificial Intelligence · Computer Science 2025-08-29 Jaeman Son , Hyunsoo Kim

The emergence of generative artificial intelligence (GAI) and large language models (LLMs) such ChatGPT has enabled the realization of long-harbored desires in software and robotic development. The technology however, has brought with it…

Large language models (LLMs) are currently at the forefront of intertwining AI systems with human communication and everyday life. Therefore, it is of great importance to evaluate their emerging abilities. In this study, we show that LLMs,…

Computation and Language · Computer Science 2023-10-10 Thilo Hagendorff , Sarah Fabi

Recent advancements in large language models (LLMs) have significantly enhanced capabilities in natural language processing and artificial intelligence. These models, including GPT-3.5 and LLaMA-2, have revolutionized text generation,…

Computation and Language · Computer Science 2024-02-06 Yunhong He , Jianling Qiu , Wei Zhang , Zhengqing Yuan

Large Language Models (LLMs) are being integrated into applications such as chatbots or email assistants. To prevent improper responses, safety mechanisms, such as Reinforcement Learning from Human Feedback (RLHF), are implemented in them.…

Cryptography and Security · Computer Science 2026-05-01 Matteo Gioele Collu , Tom Janssen-Groesbeek , Stefanos Koffas , Mauro Conti , Stjepan Picek

Large language models (LLMs) can "lie", which we define as outputting false statements despite "knowing" the truth in a demonstrable sense. LLMs might "lie", for example, when instructed to output misinformation. Here, we develop a simple…

Computation and Language · Computer Science 2023-09-28 Lorenzo Pacchiardi , Alex J. Chan , Sören Mindermann , Ilan Moscovitz , Alexa Y. Pan , Yarin Gal , Owain Evans , Jan Brauner

We investigate and observe the behaviour and performance of Large Language Model (LLM)-backed chatbots in addressing misinformed prompts and questions with demographic information within the domains of Climate Change and Mental Health.…

The validity of online behavioral research relies on study participants being human rather than machine. In the past, it was possible to detect machines by posing simple challenges that were easily solved by humans but not by machines.…

Computation and Language · Computer Science 2026-04-02 Simon Schug , Brenden M. Lake

Educators are increasingly concerned about the usage of Large Language Models (LLMs) such as ChatGPT in programming education, particularly regarding the potential exploitation of imperfections in Artificial Intelligence Generated Content…

Everyday AI detection requires differentiating between people and AI in informal, online conversations. In many cases, people will not interact directly with AI systems but instead read conversations between AI systems and other people. We…

Human-Computer Interaction · Computer Science 2024-07-15 Ishika Rathi , Sydney Taylor , Benjamin K. Bergen , Cameron R. Jones

This work explores the capability of conversational chatbots powered by large language models (LLMs), to understand and characterize predicate symmetry, a cognitive linguistic function traditionally believed to be an inherent human trait.…

Computation and Language · Computer Science 2024-07-09 Daniela N. Rim , Heeyoul Choi

Generative large language models (LLMs) have become central to everyday life, producing human-like text across diverse domains. A growing body of research investigates whether these models also exhibit personality- and demographic-like…

Computation and Language · Computer Science 2025-10-14 Dana Sotto Porat , Ella Rabinovich

The integration of Large Language Models (LLMs) and chatbots introduces new challenges and opportunities for decision-making in software testing. Decision-making relies on a variety of information, including code, requirements…

Software Engineering · Computer Science 2024-06-18 Francisco Gomes de Oliveira Neto