English
Related papers

Related papers: ChatGPT Hallucinates when Attributing Answers

200 papers

As conversational AI systems become popular for information retrieval and question-answering, the references they cite are key to ensuring their answers are reliable and trustworthy. Yet, no prior work systematically analyzes how these…

Human-Computer Interaction · Computer Science 2026-04-20 Jianheng Ouyang , Arpit Narechania

This research aims to take advantage of artificial intelligence techniques in producing students assessment that is compatible with the different academic accreditations of the same program. The possibility of using generative artificial…

Computers and Society · Computer Science 2023-12-04 Rania Anwar Aboalela

This article focuses on bibliographic references generated by the ChatGPT3.5 tool. Using this tool based on the trained GPT generation model ChatGPT3.5, developed by the company OpenAI, we explored six different themes and analyzed a sample…

Digital Libraries · Computer Science 2023-12-05 Olivier Las Vergnas

Like students facing hard exam questions, large language models sometimes guess when uncertain, producing plausible yet incorrect statements instead of admitting uncertainty. Such "hallucinations" persist even in state-of-the-art systems…

Computation and Language · Computer Science 2025-09-08 Adam Tauman Kalai , Ofir Nachum , Santosh S. Vempala , Edwin Zhang

This study evaluated the ability of ChatGPT, a recently developed artificial intelligence (AI) agent, to perform high-level cognitive tasks and produce text that is indistinguishable from human-generated text. This capacity raises concerns…

Artificial Intelligence · Computer Science 2022-12-20 Teo Susnjak

Large Language Models (LLM) have become sophisticated enough that complex computer programs can be created through interpretation of plain English sentences and implemented in a variety of modern languages such as Python, Java Script, C++…

Software Engineering · Computer Science 2023-09-04 Simon Thorne

ChatGPT is not only fun to chat with, but it also searches information, answers questions, and gives advice. With consistent moral advice, it might improve the moral judgment and decisions of users, who often hold contradictory moral…

Computers and Society · Computer Science 2023-01-19 Sebastian Krügel , Andreas Ostermaier , Matthias Uhl

Mathematical questioning is crucial for assessing students problem-solving skills. Since manually creating such questions requires substantial effort, automatic methods have been explored. Existing state-of-the-art models rely on…

Computation and Language · Computer Science 2024-02-29 Phuoc Pham Van Long , Duc Anh Vu , Nhat M. Hoang , Xuan Long Do , Anh Tuan Luu

As Large Language Models (LLMs) are predictive models building their response based on the words in the prompts, there is a risk that small talk and irrelevant information may alter the response and the suggestion given. Therefore, this…

Computation and Language · Computer Science 2023-09-19 Myriam Safrai , Amos Azaria

While open-ended self-explanations have been shown to promote robust learning in multiple studies, they pose significant challenges to automated grading and feedback in technology-enhanced learning, due to the unconstrained nature of the…

Human-Computer Interaction · Computer Science 2023-06-30 Huy A. Nguyen , Hayden Stec , Xinying Hou , Sarah Di , Bruce M. McLaren

This Paper discusses the growing popularity of online medical diagnosis as an alternative to traditional doctor visits. It highlights the limitations of existing tools and emphasizes the advantages of using ChatGPT, which provides…

Computation and Language · Computer Science 2024-03-26 Mohamed Issa , Ahmed Abdelwahed

ChatGPT has achieved remarkable success in natural language understanding. Considering that recommendation is indeed a conversation between users and the system with items as words, which has similar underlying pattern with ChatGPT, we…

Information Retrieval · Computer Science 2024-04-16 Yabin Zhang , Wenhui Yu , Erhan Zhang , Xu Chen , Lantao Hu , Peng Jiang , Kun Gai

This paper presents a comprehensive evaluation of the code generation capabilities of ChatGPT, a prominent large language model, compared to human programmers. A novel dataset of 131 code-generation prompts across 5 categories was curated…

Software Engineering · Computer Science 2023-11-07 Muhammad Fawad Akbar Khan , Max Ramsdell , Erik Falor , Hamid Karimi

The emergence of an AI-powered chatbot that can generate human-like sentences and write coherent essays has caught the world's attention. This paper discusses the historical overview of chatbots and the technology behind Chat Generative…

Computation and Language · Computer Science 2023-08-11 Sakib Shahriar , Kadhim Hayawi

ChatGPT is one of the most popular language models which achieve amazing performance on various natural language tasks. Consequently, there is also an urgent need to detect the texts generated ChatGPT from human written. One of the…

Computation and Language · Computer Science 2023-10-04 Han Xu , Jie Ren , Pengfei He , Shenglai Zeng , Yingqian Cui , Amy Liu , Hui Liu , Jiliang Tang

Generative AI technologies such as ChatGPT, Gemini, and MidJourney have made remarkable progress in recent years. Recent literature has documented ChatGPT's positive impact on productivity in areas where it has strong expertise,…

General Economics · Economics 2024-03-05 Voraprapa Nakavachara , Tanapong Potipiti , Thanee Chaiwat

This study examines the performance of ChatGPT with an experiment in the legal domain. We compare the outcome with it a baseline using regular expressions (Regex), rather than focusing solely on the assessment against human performance. The…

Artificial Intelligence · Computer Science 2025-10-23 Marianna Molinari , Ilaria Angela Amantea , Marinella Quaranta , Guido Governatori

This article presents a comparative analysis of the ability of two large language model (LLM)-based chatbots, ChatGPT and Bing Chat, recently rebranded to Microsoft Copilot, to detect veracity of political information. We use AI auditing…

Computation and Language · Computer Science 2023-12-21 Elizaveta Kuznetsova , Mykola Makhortykh , Victoria Vziatysheva , Martha Stolze , Ani Baghumyan , Aleksandra Urman

The advent of ChatGPT, a large language model-powered chatbot, has prompted questions about its potential implications for traditional search engines. In this study, we investigate the differences in user behavior when employing search…

Artificial Intelligence · Computer Science 2023-07-04 Ruiyun Xu , Yue Feng , Hailiang Chen

Prior work on large language model (LLM) hallucinations has associated them with model uncertainty or inaccurate knowledge. In this work, we define and investigate a distinct type of hallucination, where a model can consistently answer a…

Computation and Language · Computer Science 2025-08-26 Adi Simhi , Itay Itzhak , Fazl Barez , Gabriel Stanovsky , Yonatan Belinkov