中文
相关论文

相关论文: PerHalluEval: Persian Hallucination Evaluation Ben…

200 篇论文

Despite the outstanding performance in multimodal tasks, Large Vision-Language Models (LVLMs) have been plagued by the issue of hallucination, i.e., generating content that is inconsistent with the corresponding visual inputs. While…

计算机视觉与模式识别 · 计算机科学 2026-02-26 Bei Yan , Jie Zhang , Zheng Yuan , Shiguang Shan , Xilin Chen

This paper presents a comprehensive evaluation framework for assessing the cultural competence of large language models (LLMs) in Persian. Existing Persian cultural benchmarks rely predominantly on multiple-choice formats and…

计算与语言 · 计算机科学 2026-03-17 Reihaneh Iranmanesh , Saeedeh Davoudi , Pasha Abrishamchian , Ophir Frieder , Nazli Goharian

Large language models (LLMs) have emerged as pivotal contributors in contemporary natural language processing and are increasingly being applied across a diverse range of industries. However, these large-scale probabilistic statistical…

计算与语言 · 计算机科学 2024-10-10 Xun Liang , Shichao Song , Simin Niu , Zhiyu Li , Feiyu Xiong , Bo Tang , Yezhaohui Wang , Dawei He , Peng Cheng , Zhonghao Wang , Haiying Deng

Large Language Models (LLMs) have succeeded in a variety of natural language processing tasks [Zha+25]. However, they have notable limitations. LLMs tend to generate hallucinations, a seemingly plausible yet factually unsupported output…

计算与语言 · 计算机科学 2025-09-19 Martin Preiß

Hallucination, a phenomenon where multimodal large language models~(MLLMs) tend to generate textual responses that are plausible but unaligned with the image, has become one major hurdle in various MLLM-related applications. Several…

计算机视觉与模式识别 · 计算机科学 2024-10-16 Han Qiu , Jiaxing Huang , Peng Gao , Qin Qi , Xiaoqin Zhang , Ling Shao , Shijian Lu

Large Vision Language Models exhibit remarkable capabilities but struggle with hallucinations inconsistencies between images and their descriptions. Previous hallucination evaluation studies on LVLMs have identified hallucinations in terms…

人工智能 · 计算机科学 2024-11-11 Chaoya Jiang , Hongrui Jia , Wei Ye , Mengfan Dong , Haiyang Xu , Ming Yan , Ji Zhang , Shikun Zhang

Large language models (LLMs) often generate responses that deviate from user input or training data, a phenomenon known as "hallucination." These hallucinations undermine user trust and hinder the adoption of generative AI systems.…

计算与语言 · 计算机科学 2025-04-25 Yejin Bang , Ziwei Ji , Alan Schelten , Anthony Hartshorn , Tara Fowler , Cheng Zhang , Nicola Cancedda , Pascale Fung

Large Language Models (LLMs) have demonstrated remarkable capabilities across numerous languages; however, their effectiveness in low-resource languages like Persian requires thorough investigation. This paper presents a comprehensive…

计算与语言 · 计算机科学 2025-10-16 Mahdi Cherakhloo , Arash Abbasi , Mohammad Saeid Sarafraz , Bijan Vosoughi Vahdat

Recent advancements in large vision-language models (VLMs) have primarily focused on English, with limited attention given to other languages. To address this gap, we introduce MEENA (also known as PersianMMMU), the first dataset designed…

Large Language Models (LLMs) have demonstrated remarkable proficiency in generating text that closely resemble human writing. However, they often generate factually incorrect statements, a problem typically referred to as 'hallucination'.…

Large Vision Language Models (LVLMs) have recently achieved superior performance in various tasks on natural image and text data, which inspires a large amount of studies for LVLMs fine-tuning and training. Despite their advancements, there…

计算机视觉与模式识别 · 计算机科学 2024-07-04 Zishan Gu , Changchang Yin , Fenglin Liu , Ping Zhang

Hallucinations in Large Language Models (LLMs) pose a significant challenge, generating misleading or unverifiable content that undermines trust and reliability. Existing evaluation methods, such as KnowHalu, employ multi-stage verification…

计算与语言 · 计算机科学 2026-04-10 Chenggong Zhang , Haopeng Wang , Hexi Meng

As large language models (LLMs) become increasingly embedded in our daily lives, evaluating their quality and reliability across diverse contexts has become essential. While comprehensive benchmarks exist for assessing LLM performance in…

As large language models (LLMs) evolve from conversational assistants into agents capable of handling complex tasks, they are increasingly deployed in high-risk domains. However, existing benchmarks largely rely on mixed queries and…

计算与语言 · 计算机科学 2026-04-28 Yuhe Wu , Guangyu Wang , Yuran Chen , Jiatong Zhang , Yutong Zhang , Yujie Chen , Jiaming Shang , Guang Zhang , Zhuang Liu

Large Language Models (LLMs) have demonstrated remarkable capabilities, revolutionizing the integration of AI in daily life applications. However, they are prone to hallucinations, generating claims that contradict established facts,…

计算与语言 · 计算机科学 2024-06-14 A B M Ashikur Rahman , Saeed Anwar , Muhammad Usman , Ajmal Mian

Medical consumer question answering (CQA) is crucial for empowering patients by providing personalized and reliable health information. Despite recent advances in large language models (LLMs) for medical QA, consumer-oriented and…

计算与语言 · 计算机科学 2025-05-27 Naghmeh Jamali , Milad Mohammadi , Danial Baledi , Zahra Rezvani , Hesham Faili

This paper explores the efficacy of large language models (LLMs) for Persian. While ChatGPT and consequent LLMs have shown remarkable performance in English, their efficiency for more low-resource languages remains an open question. We…

Despite remarkable advancements in mitigating hallucinations in large language models (LLMs) by retrieval augmentation, it remains challenging to measure the reliability of LLMs using static question-answering (QA) data. Specifically, given…

计算与语言 · 计算机科学 2024-06-04 Xiaodong Yu , Hao Cheng , Xiaodong Liu , Dan Roth , Jianfeng Gao

Large language models (LLMs) have made great progress in classification and text generation tasks. However, they are mainly trained on English data and often struggle with low-resource languages. In this study, we explore adding a new…

计算与语言 · 计算机科学 2025-01-09 Samin Mahdizadeh Sani , Pouya Sadeghi , Thuy-Trang Vu , Yadollah Yaghoobzadeh , Gholamreza Haffari

This survey presents a comprehensive analysis of the phenomenon of hallucination in multimodal large language models (MLLMs), also known as Large Vision-Language Models (LVLMs), which have demonstrated significant advancements and…

计算机视觉与模式识别 · 计算机科学 2025-04-03 Zechen Bai , Pichao Wang , Tianjun Xiao , Tong He , Zongbo Han , Zheng Zhang , Mike Zheng Shou