English
Related papers

Related papers: Beyond ROUGE: N-Gram Subspace Features for LLM Hal…

200 papers

Recent advances in large language models (LLMs) have demonstrated remarkable capabilities in code generation tasks. However, when applied to hardware description languages (HDL), these models exhibit significant limitations due to data…

Computation and Language · Computer Science 2025-03-24 Heng Ping , Shixuan Li , Peiyu Zhang , Anzhe Cheng , Shukai Duan , Nikos Kanakaris , Xiongye Xiao , Wei Yang , Shahin Nazarian , Andrei Irimia , Paul Bogdan

Hallucination, the generation of factually incorrect content, is a growing challenge in Large Language Models (LLMs). Existing detection and mitigation methods are often isolated and insufficient for domain-specific needs, lacking a…

Computation and Language · Computer Science 2025-01-22 Mengfei Liang , Archish Arun , Zekun Wu , Cristian Munoz , Jonathan Lutch , Emre Kazim , Adriano Koshiyama , Philip Treleaven

Large language models (LLMs) can generate fluent natural language texts when given relevant documents as background context. This ability has attracted considerable interest in developing industry applications of LLMs. However, LLMs are…

Computation and Language · Computer Science 2023-10-11 Deren Lei , Yaxi Li , Mengya Hu , Mingyu Wang , Vincent Yun , Emily Ching , Eslam Kamal

Large Language Models (LLMs) have become increasingly important in natural language processing, enabling advanced data analytics through natural language queries. However, these models often generate "hallucinations"-inaccurate or…

Computation and Language · Computer Science 2024-10-29 Mikhail Rumiantsau , Aliaksei Vertsel , Ilya Hrytsuk , Isaiah Ballah

Large language models (LLMs) are susceptible to hallucinations -- factually incorrect outputs -- leading to a large body of work on detecting and mitigating such cases. We argue that it is important to distinguish between two types of…

Computation and Language · Computer Science 2025-02-19 Adi Simhi , Jonathan Herzig , Idan Szpektor , Yonatan Belinkov

Hallucination, the generation of factually incorrect information, remains a significant challenge for large language models (LLMs), especially in open-domain long-form generation. Existing approaches for detecting hallucination in long-form…

Large Language Models (LLMs) have transformed natural language processing (NLP) tasks, but they suffer from hallucination, generating plausible yet factually incorrect content. This issue extends to Video-Language Models (VideoLLMs), where…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Ahmad Khalil , Mahmoud Khalil , Alioune Ngom

Advancement in large pretrained language models has significantly improved their performance for conditional language generation tasks including summarization albeit with hallucinations. To reduce hallucinations, conventional methods…

Computation and Language · Computer Science 2023-11-15 Arvind Krishna Sridhar , Erik Visser

Vision-language models (VLMs) now rival human performance on many multimodal tasks, yet they still hallucinate objects or generate unsafe text. Current hallucination detectors, e.g., single-token linear probing (LP) and PTrue, typically…

Artificial Intelligence · Computer Science 2025-10-22 Geigh Zollicoffer , Minh Vu , Manish Bhattarai

Advancements in Large Language Models (LLMs) and their increasing use in medical question-answering necessitate rigorous evaluation of their reliability. A critical challenge lies in hallucination, where models generate plausible yet…

Computation and Language · Computer Science 2025-02-21 Shrey Pandit , Jiawei Xu , Junyuan Hong , Zhangyang Wang , Tianlong Chen , Kaidi Xu , Ying Ding

Recent work has demonstrated state-of-the-art results in large language model (LLM) hallucination detection and mitigation through consistency-based approaches which involve aggregating multiple responses sampled from a single LLM for a…

Machine Learning · Computer Science 2025-10-24 Demian Till , John Smeaton , Peter Haubrick , Gouse Saheb , Florian Graef , David Berman

Hallucination, i.e., generating factually incorrect content, remains a critical challenge for large language models (LLMs). We introduce TOHA, a TOpology-based HAllucination detector in the RAG setting, which leverages a topological…

Retrieval-Augmented Generation (RAG) is widely used to augment the input to Large Language Models (LLMs) with external information, such as recent or domain-specific knowledge. Nonetheless, current models still produce closed-domain…

Computation and Language · Computer Science 2026-04-20 Fabian Ridder , Laurin Lessel , Malte Schilling

Hallucinations of vision-language models (VLMs), which are misalignments between visual content and generated text, undermine the reliability of VLMs. One common approach for detecting them employs the same VLM, or a different one, to…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Ofir Azachi , Kfir Eliyahu , Eyal El Ani , Rom Himelstein , Roi Reichart , Yuval Pinter , Nitay Calderon

The Large Visual Language Models (LVLMs) enhances user interaction and enriches user experience by integrating visual modality on the basis of the Large Language Models (LLMs). It has demonstrated their powerful information processing and…

Artificial Intelligence · Computer Science 2024-10-22 Wei Lan , Wenyi Chen , Qingfeng Chen , Shirui Pan , Huiyu Zhou , Yi Pan

We present a neurosymbolic approach, TEN, for extracting tabular data from semistructured input text. This task is particularly challenging for text input that does not use special delimiters consistently to separate columns and rows.…

Computation and Language · Computer Science 2025-08-14 Nikita Mehrotra , Aayush Kumar , Sumit Gulwani , Arjun Radhakrishna , Ashish Tiwari

When asked to summarize articles or answer questions given a passage, large language models (LLMs) can hallucinate details and respond with unsubstantiated answers that are inaccurate with respect to the input context. This paper describes…

Computation and Language · Computer Science 2024-10-04 Yung-Sung Chuang , Linlu Qiu , Cheng-Yu Hsieh , Ranjay Krishna , Yoon Kim , James Glass

Contemporary Language Models (LMs), while impressively fluent, often generate content that is factually incorrect or unfaithful to the input context - a critical issue commonly referred to as 'hallucination'. This tendency of LMs to…

Computation and Language · Computer Science 2025-06-24 Anwoy Chatterjee , Yash Goel , Tanmoy Chakraborty

Hallucination, or the generation of incorrect or fabricated information, remains a critical challenge in large language models (LLMs), particularly in high-stake domains such as legal question answering (QA). In order to mitigate the…

Computation and Language · Computer Science 2025-01-14 Yinghao Hu , Leilei Gan , Wenyi Xiao , Kun Kuang , Fei Wu

Large Language Models (LLMs) are powerful and widely adopted, but their practical impact is limited by the well-known hallucination phenomenon. While recent hallucination detection methods have made notable progress, we find most of them…

Computation and Language · Computer Science 2026-04-21 Boshui Chen , Zhaoxin Fan , Ke Wang , Zhiying Leng , Faguo Wu , Hongwei Zheng , Yifan Sun , Wenjun Wu