English
Related papers

Related papers: Post-hoc Utterance Refining Method by Entity Minin…

200 papers

Large Language Models (LLMs), particularly slow-thinking models, often exhibit severe hallucination, outputting incorrect content due to an inability to accurately recognize knowledge boundaries during reasoning. While Reinforcement…

Artificial Intelligence · Computer Science 2026-04-17 Baochang Ren , Shuofei Qiao , Da Zheng , Huajun Chen , Ningyu Zhang

Retrieval-Augmented Generation (RAG) significantly enhances Large Language Models (LLMs), but simultaneously exposes a critical vulnerability to knowledge poisoning attacks. Existing attack methods like PoisonedRAG remain detectable due to…

Cryptography and Security · Computer Science 2026-04-10 Ziye Wang , Guanyu Wang , Kailong Wang

Unsupervised methods are widely used to induce latent semantic structure from large text collections, yet their outputs often contain incoherent, redundant, or poorly grounded clusters that are difficult to validate without labeled data. We…

Computation and Language · Computer Science 2026-04-21 Tunazzina Islam

In the era of large language models (LLMs), hallucination (i.e., the tendency to generate factually incorrect content) poses great challenge to trustworthy and reliable deployment of LLMs in real-world applications. To tackle the LLM…

Computation and Language · Computer Science 2024-01-09 Junyi Li , Jie Chen , Ruiyang Ren , Xiaoxue Cheng , Wayne Xin Zhao , Jian-Yun Nie , Ji-Rong Wen

Large Language Models (LLMs) excel in many NLP tasks but remain prone to hallucinations, limiting trust in real-world applications. We present HalluGuard, a 4B-parameter Small Reasoning Model (SRM) for mitigating hallucinations in…

Computation and Language · Computer Science 2025-10-02 Loris Bergeron , Ioana Buhnila , Jérôme François , Radu State

Reducing and detecting hallucinations in large language models is an open research problem. In this project, we attempt to leverage recent advances in the field of uncertainty estimation to reduce hallucinations in frozen large language…

Computation and Language · Computer Science 2023-12-27 Shreyas Verma , Kien Tran , Yusuf Ali , Guangyu Min

Reward models (RMs) are essential for aligning Large Language Models (LLMs) with human preferences. However, they often struggle with capturing complex human preferences and generalizing to unseen data. To address these challenges, we…

Computation and Language · Computer Science 2025-08-06 Anamika Lochab , Ruqi Zhang

The emergence of large language models (LLMs) has significantly advanced the development of natural language processing (NLP), especially in text generation tasks like question answering. However, model hallucinations remain a major…

Computation and Language · Computer Science 2025-12-01 Zhongxin Liu , Zhiwei Wang , Jun Niu , Ying Li , Hongyu Sun , Meng Xu , He Wang , Gaofei Wu , Yuqing Zhang

Supervised fine-tuning of large language models relies on human-annotated data, yet annotation pipelines routinely involve multiple crowdworkers of heterogeneous expertise. Standard practice aggregates labels via majority vote or simple…

Machine Learning · Computer Science 2026-04-21 Sajjad Ghiasvand , Mark Beliaev , Mahnoosh Alizadeh , Ramtin Pedarsani

Despite significant advancements in multimodal reasoning tasks, existing Large Vision-Language Models (LVLMs) are prone to producing visually ungrounded responses when interpreting associated images. In contrast, when humans embark on…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 Zexian Yang , Dian Li , Dayan Wu , Gang Liu , Weiping Wang

Large Language Models (LLMs) have shown impressive capabilities but still suffer from the issue of hallucinations. A significant type of this issue is the false premise hallucination, which we define as the phenomenon when LLMs generate…

Computation and Language · Computer Science 2024-03-01 Hongbang Yuan , Pengfei Cao , Zhuoran Jin , Yubo Chen , Daojian Zeng , Kang Liu , Jun Zhao

Large Language Models (LLMs) have shown impressive capabilities but also a concerning tendency to hallucinate. This paper presents RefChecker, a framework that introduces claim-triplets to represent claims in LLM responses, aiming to detect…

Computation and Language · Computer Science 2024-05-24 Xiangkun Hu , Dongyu Ru , Lin Qiu , Qipeng Guo , Tianhang Zhang , Yang Xu , Yun Luo , Pengfei Liu , Yue Zhang , Zheng Zhang

Generating with citations is crucial for trustworthy Large Language Models (LLMs), yet even advanced LLMs often produce mismatched or irrelevant citations. Existing methods over-optimize citation fidelity while overlooking relevance to the…

Information Retrieval · Computer Science 2026-02-24 Yixing Peng , Licheng Zhang , Shancheng Fang , Yi Liu , Peijian Gu , Quan Wang

Retrieval-based conversation systems generally tend to highly rank responses that are semantically similar or even identical to the given conversation context. While the system's goal is to find the most appropriate response, rather than…

Computation and Language · Computer Science 2018-10-09 Denis Fedorenko , Nikita Smetanin , Artem Rodichev

How to alleviate the hallucinations of Large Language Models (LLMs) has always been the fundamental goal pursued by the LLMs research community. Looking through numerous hallucination-related studies, a mainstream category of methods is to…

Computation and Language · Computer Science 2025-02-12 Yinghui Li , Haojing Huang , Jiayi Kuang , Yangning Li , Shu-Yu Guo , Chao Qu , Xiaoyu Tan , Hai-Tao Zheng , Ying Shen , Philip S. Yu

The ability to derive underlying principles from a handful of observations and then generalize to novel situations -- known as inductive reasoning -- is central to human intelligence. Prior work suggests that language models (LMs) often…

Computation and Language · Computer Science 2024-05-24 Linlu Qiu , Liwei Jiang , Ximing Lu , Melanie Sclar , Valentina Pyatkin , Chandra Bhagavatula , Bailin Wang , Yoon Kim , Yejin Choi , Nouha Dziri , Xiang Ren

Reinforcement learning (RL) has emerged as a promising paradigm for enhancing image editing and text-to-image (T2I) generation. However, current reward models, which act as critics during RL, often suffer from hallucinations and assign…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Xiangyu Zhao , Peiyuan Zhang , Junming Lin , Tianhao Liang , Yuchen Duan , Shengyuan Ding , Changyao Tian , Yuhang Zang , Junchi Yan , Xue Yang

Query expansion is a long-standing technique to mitigate vocabulary mismatch in ad hoc Information Retrieval. Pseudo-relevance feedback methods, such as RM3, estimate an expanded query model from the top-ranked documents, but remain…

Information Retrieval · Computer Science 2026-01-19 David Otero , Javier Parapar

Fact-seeking question answering with large language models (LLMs) remains unreliable when answers depend on up-to-date or conflicting information. Although retrieval-augmented and tool-using LLMs reduce hallucinations, they often rely on…

Computation and Language · Computer Science 2026-03-17 Auksarapak Kietkajornrit , Jad Tarifi , Nima Asgharbeygi

Large Language Models (LLMs) frequently produce factually inaccurate outputs - a phenomenon known as hallucination - which limits their accuracy in knowledge-intensive NLP tasks. Retrieval-augmented generation and agentic frameworks such as…

Computation and Language · Computer Science 2025-04-01 Alexander Murphy , Mohd Sanad Zaki Rizvi , Aden Haussmann , Ping Nie , Guifu Liu , Aryo Pradipta Gema , Pasquale Minervini