English
Related papers

Related papers: The Turing Deception

200 papers

Background: The integration of artificial intelligence (AI) into daily life, particularly through chatbots utilizing natural language processing (NLP), presents both revolutionary potential and unique challenges. This intended to…

Computation and Language · Computer Science 2024-04-16 Gian Alexandre Michaelsen , Renato P. dos Santos

ChatGPT is a groundbreaking ``chatbot"--an AI interface built on a large language model that was trained on an enormous corpus of human text to emulate human conversation. Beyond its ability to converse in a plausible way, it has attracted…

Physics Education · Physics 2023-03-28 Colin G. West

Large Language Models (LLMs), such as GPT-3 and BERT, reshape how textual content is written and communicated. These models have the potential to generate scientific content that is indistinguishable from that written by humans. Hence, LLMs…

Computation and Language · Computer Science 2024-11-19 Bushra Alhijawi , Rawan Jarrar , Aseel AbuAlRub , Arwa Bader

Computer programming is a fundamental tool for life scientists, allowing them to carry out many essential research tasks. However, despite a variety of educational efforts, learning to write code can be a challenging endeavor for both…

Other Quantitative Biology · Quantitative Biology 2024-01-02 Stephen R. Piccolo , Paul Denny , Andrew Luxton-Reilly , Samuel Payne , Perry G. Ridge

In 1950, Alan Turing proposed an imitation game as the ultimate test of whether a machine was intelligent: could a machine imitate a human so well that its answers to questions indistinguishable from a human. Ever since, creating…

General Economics · Economics 2022-01-13 Erik Brynjolfsson

Context: The advent of Large Language Model-driven tools like ChatGPT offers software engineers an interactive alternative to community question-answering (CQA) platforms like Stack Overflow. While Stack Overflow provides benefits from the…

Software Engineering · Computer Science 2024-10-01 Mohammed Mehedi Hasan , Mahady Hasan , Mamun Bin Ibne Reaz , Jannat Un Nayeem Iqra

Hallucinations, the tendency to produce irrelevant/incorrect responses, are prevalent concerns in generative AI-based tools like ChatGPT. Although hallucinations in ChatGPT are studied for textual responses, it is unknown how ChatGPT…

Software Engineering · Computer Science 2024-11-13 Salma Begum Tamanna , Gias Uddin , Song Wang , Lan Xia , Longyu Zhang

With the launch of ChatGPT, large language models (LLMs) have attracted global attention. In the realm of article writing, LLMs have witnessed extensive utilization, giving rise to concerns related to intellectual property protection,…

Computation and Language · Computer Science 2024-06-14 Ying Zhou , Ben He , Le Sun

There has been concern about ideological basis and possible discrimination in text generated by Large Language Models (LLMs). We test possible value biases in ChatGPT using a psychological value theory. We designed a simple experiment in…

Computation and Language · Computer Science 2023-04-10 Ronald Fischer , Markus Luczak-Roesch , Johannes A Karl

ChatGPT and other large language models (LLMs) promise to revolutionize software development by automatically generating code from program specifications. We assess the performance of ChatGPT's GPT-3.5-turbo model on LeetCode, a popular…

Software Engineering · Computer Science 2024-11-13 Minda Li , Bhaskar Krishnamachari

ChatGPT, an AI chatbot, has gained popularity for its capability in generating human-like responses. However, this feature carries several risks, most notably due to its deceptive behaviour such as offering users misleading or fabricated…

Computers and Society · Computer Science 2023-06-27 Xiao Zhan , Yifan Xu , Stefan Sarkadi

Generative AI models garnered a large amount of public attention and speculation with the release of OpenAIs chatbot, ChatGPT. At least two opinion camps exist: one excited about possibilities these models offer for fundamental changes to…

Artificial Intelligence · Computer Science 2024-06-28 Ann Speed

In his seminal paper ``Computing Machinery and Intelligence'', Alan Turing introduced the ``imitation game'' as part of exploring the concept of machine intelligence. The Turing Test has since been the subject of much analysis, debate,…

Artificial Intelligence · Computer Science 2023-08-03 David Harel , Assaf Marron

The pursuit of article or text summarization has captured the attention of natural language processing (NLP) practitioners, presenting itself as a formidable challenge. ChatGPT 3.5 exhibits the capacity to condense the content of up to 3000…

Computation and Language · Computer Science 2023-12-08 Arman Sarraf , Amirabbas Abbaspour

As large language models (LLMs) become increasingly commonplace, concern about distinguishing between human and AI text increases as well. The growing power of these models is of particular concern to teachers, who may worry that students…

Artificial Intelligence · Computer Science 2024-04-18 James Weichert , Chinecherem Dimobi

Given the growing use of generative artificial intelligence as a tool for creating multilingual content and bypassing both machine and traditional translation methods, this study explores the ability of linguistically trained individuals to…

Computation and Language · Computer Science 2025-04-21 Michael Farrell

While subjective evaluations in recent years indicate rapid progress in TTS, can current TTS systems truly pass a human deception test in a Turing-like evaluation? We introduce Human Fooling Rate (HFR), a metric that directly measures how…

Computation and Language · Computer Science 2025-08-07 Praveen Srinivasa Varadhan , Sherry Thomas , Sai Teja M. S. , Suvrat Bhooshan , Mitesh M. Khapra

Chat Generative Pre-trained Transformer (ChatGPT) has gained significant interest and attention since its launch in November 2022. It has shown impressive performance in various domains, including passing exams and creative writing.…

Computation and Language · Computer Science 2023-08-28 Shahab Saquib Sohail , Faiza Farhat , Yassine Himeur , Mohammad Nadeem , Dag Øivind Madsen , Yashbir Singh , Shadi Atalla , Wathiq Mansoor

The launch of ChatGPT in November 2022 marked the beginning of a new era in AI, the availability of generative AI tools for everyone to use. ChatGPT and other similar chatbots boast a wide range of capabilities from answering student…

Computation and Language · Computer Science 2024-09-04 Yanchen Wang , Lisa Singh

In recent years, large neural networks for natural language generation (NLG) have made leaps and bounds in their ability to generate fluent text. However, the tasks of evaluating quality differences between NLG systems and understanding how…

Computation and Language · Computer Science 2020-10-08 Liam Dugan , Daphne Ippolito , Arun Kirubarajan , Chris Callison-Burch