English
Related papers

Related papers: SSFO: Self-Supervised Faithfulness Optimization fo…

200 papers

Large Language Models~(LLMs) are prone to hallucinations, and Retrieval-Augmented Generation (RAG) helps mitigate this, but at a high computational cost while risking misinformation. Adaptive retrieval aims to retrieve only when necessary,…

Large Language Models (LLMs) excel at various natural language processing tasks but remain vulnerable to jailbreaking attacks that induce harmful content generation. In this paper, we reveal a critical safety inconsistency: LLMs can more…

Computation and Language · Computer Science 2025-08-27 Peng Ding , Wen Sun , Dailin Li , Wei Zou , Jiaming Wang , Jiajun Chen , Shujian Huang

Rerankers play a pivotal role in refining retrieval results for Retrieval-Augmented Generation. However, current reranking models are typically optimized on static human annotated relevance labels in isolation, decoupled from the downstream…

Computation and Language · Computer Science 2026-04-03 Yuhang Wu , Xiangqing Shen , Fanfan Wang , Cangqi Zhou , Zhen Wu , Xinyu Dai , Rui Xia

Large vision-language models (LVLMs) suffer from hallucination, resulting in misalignment between the output textual response and the input visual content. Recent research indicates that the over-reliance on the Large Language Model (LLM)…

Computer Vision and Pattern Recognition · Computer Science 2024-11-06 Yuxi Xie , Guanzhen Li , Xiao Xu , Min-Yen Kan

Retrieval-Augmented Generation (RAG) reduces hallucinations by grounding answers in retrieved evidence, yet standard retrievers often exhibit retrieval sycophancy: they preferentially surface evidence that supports a user's premise, even…

Computation and Language · Computer Science 2025-12-29 Mayank Ravishankara

Large language models (LLMs) are increasingly adopted in clinical decision support, yet aligning them with the multifaceted reasoning pathways of real-world medicine remains a major challenge. Using more than 8,000 infertility treatment…

Machine Learning · Computer Science 2025-11-25 Dou Liu , Ying Long , Sophia Zuoqiu , Kaipeng Xie , Runze Yang , Di Liu , Kang Li , Yiting Lin , Hanyi Liu , Rong Yin , Tian Tang

Large Language Models (LLMs) have become increasingly popular due to their ability to process and generate natural language. However, as they are trained on massive datasets of text, LLMs can inherit harmful biases and produce outputs that…

Computation and Language · Computer Science 2025-01-23 Qi Gou , Cam-Tu Nguyen

Multimodal Large Reasoning Models introduce the reasoning paradigm, demonstrating strong capabilities on complex vision-language tasks. However, they still suffer from severe hallucinations. Existing training-based methods typically…

Artificial Intelligence · Computer Science 2026-05-28 Jiawei Kong , Hao Fang , Shunxiang Liao , Jinyu Li , Bin Chen , Hao Wu , Shu-Tao Xia , Min Zhang

While Retrieval-Augmented Generation (RAG) enables large language models (LLMs) to generate contextually grounded responses, contextual faithfulness remains challenging as LLMs may not consistently trust provided context, leading to…

Computation and Language · Computer Science 2026-02-10 Yongchao Long , Xian Wu , Yingying Zhang , Xianbin Wen , Yuxi Zhou , Shenda Hong

Aviation training is a core link in ensuring flight safety, improving industry efficiency and promoting sustainable development. It not only involves flight simulation but also requires the learning of a great deal of professional aviation…

Artificial Intelligence · Computer Science 2025-06-18 Jia'ang Wan , Feng Shen , Fujuan Li , Yanjin Sun , Yan Li , Shiwen Zhang

While Retrieval-Augmented Generation (RAG) systems enhance Large Language Models (LLMs) by incorporating external knowledge, they still face persistent challenges in retrieval inefficiency and the inability of LLMs to filter out irrelevant…

Computation and Language · Computer Science 2025-02-13 Ruobing Yao , Yifei Zhang , Shuang Song , Yuhua Liu , Neng Gao , Chenyang Tu

Multimodal large language models (MLLMs) have achieved remarkable success across various tasks. However, separate training of visual and textual encoders often results in a misalignment of the modality. Such misalignment may lead models to…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Songtao Jiang , Yan Zhang , Ruizhe Chen , Tianxiang Hu , Yeying Jin , Qinglin He , Yang Feng , Jian Wu , Zuozhu Liu

As large language models (LLMs) are increasingly deployed in critical decision-making systems, the lack of reliable methods to measure their uncertainty presents a fundamental trustworthiness risk. We introduce a normalized confidence score…

Machine Learning · Computer Science 2026-03-10 Xie Xiaohu , Liu Xiaohu , Yao Benjamin

Industrial advertising question answering (QA) is a high-stakes task in which hallucinated content, particularly fabricated URLs, can lead to financial loss, compliance violations, and legal risk. Although Retrieval-Augmented Generation…

Computation and Language · Computer Science 2026-02-27 Wenwei Li , Ming Xu , Tianle Xia , Lingxiang Hu , Yiding Sun , Linfang Shang , Liqun Liu , Peng Shu , Huan Yu , Jie Jiang

The emergence of Large Language Models (LLMs) has significantly advanced natural language processing, but these models often generate factually incorrect information, known as "hallucination". Initial retrieval-augmented generation (RAG)…

Computation and Language · Computer Science 2024-11-12 Yujia Zhou , Zheng Liu , Zhicheng Dou

Retrieval-Augmented Generation (RAG) has been shown to enhance the factual accuracy of Large Language Models (LLMs), but existing methods often suffer from limited reasoning capabilities in effectively using the retrieved evidence,…

Computation and Language · Computer Science 2024-10-03 Shayekh Bin Islam , Md Asib Rahman , K S M Tozammel Hossain , Enamul Hoque , Shafiq Joty , Md Rizwan Parvez

Despite their remarkable capabilities, large language models (LLMs) often produce responses containing factual inaccuracies due to their sole reliance on the parametric knowledge they encapsulate. Retrieval-Augmented Generation (RAG), an ad…

Computation and Language · Computer Science 2023-10-19 Akari Asai , Zeqiu Wu , Yizhong Wang , Avirup Sil , Hannaneh Hajishirzi

Direct Preference Optimization (DPO) has shown strong potential for mitigating hallucinations in Multimodal Large Language Models (MLLMs). However, existing multimodal DPO approaches often suffer from overfitting due to the difficulty…

Artificial Intelligence · Computer Science 2026-01-05 Longtian Qiu , Shan Ning , Chuyu Zhang , Jiaxuan Sun , Xuming He

Large Language Models (LLMs) enhanced with retrieval, an approach known as Retrieval-Augmented Generation (RAG), have achieved strong performance in open-domain question answering. However, RAG remains prone to hallucinations: factually…

The rapid rise of synthetic media has made deepfake detection a critical challenge for online safety and trust. Progress remains constrained by the scarcity of large, high-quality datasets. Although multimodal large language models (LLMs)…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Tuan Nguyen , Naseem Khan , Khang Tran , NhatHai Phan , Issa Khalil