中文
相关论文

相关论文: Evaluating the Accuracy of Chatbots in Financial L…

200 篇论文

Large Language models (LLMs) show extraordinary abilities, but they are still prone to hallucinations, especially when we use them for generating Academic content. We have investigated four popular LLMs, ChatGPT, Grok, Gemini, and Copilot…

计算与语言 · 计算机科学 2026-05-07 Humam Khan , Md Tabrez Nafis , Shahab Saquib Sohail , Aqeel Khalique , Rehan Hasan Khan

Hallucination remains a persistent challenge in Large Language Models (LLMs), particularly in context-grounded settings such as RAG and agentic AI systems. This study focuses on contextual hallucination detection in summarization tasks. We…

计算与语言 · 计算机科学 2026-05-12 I. F. Atasoy , B. Mutlu , E. A. Sezer , A. Wahdan

Hallucinations, the tendency to produce irrelevant/incorrect responses, are prevalent concerns in generative AI-based tools like ChatGPT. Although hallucinations in ChatGPT are studied for textual responses, it is unknown how ChatGPT…

软件工程 · 计算机科学 2024-11-13 Salma Begum Tamanna , Gias Uddin , Song Wang , Lan Xia , Longyu Zhang

This study analyzes the performance of eight generative artificial intelligence chatbots -- ChatGPT, Claude, Copilot, DeepSeek, Gemini, Grok, Le Chat, and Perplexity -- in their free versions, in the task of generating academic…

信息检索 · 计算机科学 2026-05-20 Álvaro Cabezas-Clavijo , Pavel Sidorenko-Bautista

Large language models (LLMs) are increasingly used in newsroom workflows, but their tendency to hallucinate poses risks to core journalistic practices of sourcing, attribution, and accuracy. We evaluate three widely used tools - ChatGPT,…

计算与语言 · 计算机科学 2025-10-01 Nick Hagar , Wilma Agustianto , Nicholas Diakopoulos

People increasingly hold sustained, open-ended conversations with large language models (LLMs). Public reports and early studies suggest that, in such settings, models can reinforce delusional or conspiratorial ideation or even amplify…

人机交互 · 计算机科学 2026-04-09 Peter Kirgis , Ben Hawriluk , Sherrie Feng , Aslan Bilimer , Sam Paech , Zeynep Tufekci

Large language models have the potential to be valuable in the healthcare industry, but it's crucial to verify their safety and effectiveness through rigorous evaluation. For this purpose, we comprehensively evaluated both open-source LLMs…

计算与语言 · 计算机科学 2024-02-13 Ankit Pal , Malaikannan Sankarasubbu

Artificial Intelligence (AI) chatbots leveraging Large Language Models (LLMs) are gaining traction in healthcare for their potential to automate patient interactions and aid clinical decision-making. This study examines the reliability of…

人工智能 · 计算机科学 2024-05-24 Ayesha Siddika Nipu , K M Sajjadul Islam , Praveen Madiraju

AI chatbots are rapidly shaping how people encounter the news, yet no prior study has systematically measured how accurately these systems, with their proprietary search integrations and retrieval-synthesis pipelines, handle emerging facts…

计算与语言 · 计算机科学 2026-05-22 Mirac Suzgun , Emily Shen , Federico Bianchi , Alexander Spangher , Thomas Icard , Daniel E. Ho , Dan Jurafsky , James Zou

Large Language Models (LLMs) are widely used in industry but remain prone to hallucinations, limiting their reliability in critical applications. This work addresses hallucination reduction in consumer grievance chatbots built using LLaMA…

Large language models (LLMs) like ChatGPT demonstrate the remarkable progress of artificial intelligence. However, their tendency to hallucinate -- generate plausible but false information -- poses a significant challenge. This issue is…

计算与语言 · 计算机科学 2024-06-13 Philip Feldman , James R. Foulds , Shimei Pan

Recent progress in generative AI, including large language models (LLMs) like ChatGPT, has opened up significant opportunities in fields ranging from natural language processing to knowledge discovery and data mining. However, there is also…

人工智能 · 计算机科学 2024-04-03 Navapat Nananukul , Mayank Kejriwal

Large language models (LLMs) are increasingly applied in educational, clinical, and professional settings, but their tendency for sycophancy -- prioritizing user agreement over independent reasoning -- poses risks to reliability. This study…

人工智能 · 计算机科学 2025-09-22 Aaron Fanous , Jacob Goldberg , Ank A. Agarwal , Joanna Lin , Anson Zhou , Roxana Daneshjou , Sanmi Koyejo

Large language models (LMs) are prone to generate factual errors, which are often called hallucinations. In this paper, we introduce a comprehensive taxonomy of hallucinations and argue that hallucinations manifest in diverse forms, each…

Can ChatGPT provide evidence to support its answers? Does the evidence it suggests actually exist and does it really support its answer? We investigate these questions using a collection of domain-specific knowledge-based questions,…

人工智能 · 计算机科学 2023-09-19 Guido Zuccon , Bevan Koopman , Razia Shaik

Large language models (LLMs), such as ChatGPT, are prone to generate hallucinations, i.e., content that conflicts with the source or cannot be verified by the factual knowledge. To understand what types of content and to which extent LLMs…

计算与语言 · 计算机科学 2023-10-24 Junyi Li , Xiaoxue Cheng , Wayne Xin Zhao , Jian-Yun Nie , Ji-Rong Wen

This paper introduces fourteen novel datasets for the evaluation of Large Language Models' safety in the context of enterprise tasks. A method was devised to evaluate a model's safety, as determined by its ability to follow instructions and…

计算与语言 · 计算机科学 2024-04-16 David Nadeau , Mike Kroutikov , Karen McNeil , Simon Baribeau

A major risk of using language models in practical applications is their tendency to hallucinate incorrect statements. Hallucinations are often attributed to knowledge gaps in LMs, but we hypothesize that in some cases, when justifying…

计算与语言 · 计算机科学 2023-05-24 Muru Zhang , Ofir Press , William Merrill , Alisa Liu , Noah A. Smith

This paper presents a bibliometric analysis of the scientific literature related to chatbots, focusing specifically on ChatGPT. Chatbots have gained increasing attention recently, with an annual growth rate of 19.16% and 27.19% on the Web…

数字图书馆 · 计算机科学 2023-04-13 Hamed Khosravi , Mohammad Reza Shafie , Morteza Hajiabadi , Ahmed Shoyeb Raihan , Imtiaz Ahmed

Large language models (LLMs) exhibit powerful general intelligence across diverse scenarios, including their integration into chatbots. However, a vital challenge of LLM-based chatbots is that they may produce hallucinated content in…

计算与语言 · 计算机科学 2025-04-18 Weitao Li , Junkai Li , Weizhi Ma , Yang Liu
‹ 上一页 1 2 3 10 下一页 ›