English
Related papers

Related papers: RefusalBench: Generative Evaluation of Selective R…

200 papers

Multilingual Retrieval-Augmented Generation (mRAG) leverages cross-lingual evidence to ground Large Language Models (LLMs) in global knowledge. However, we show that current mRAG systems suffer from a language bias during reranking,…

Computation and Language · Computer Science 2026-04-23 Dan Wang , Guozhao Mo , Yafei Shi , Cheng Zhang , Bo Zheng , Boxi Cao , Xuanang Chen , Yaojie Lu , Hongyu Lin , Ben He , Xianpei Han , Le Sun

In real-world scenarios, providing user queries with visually enhanced responses can considerably benefit understanding and memory, underscoring the great value of interleaved image-text generation. Despite recent progress, like the visual…

Information Retrieval · Computer Science 2025-12-08 Rongyang Zhang , Yuqing Huang , Chengqiang Lu , Qimeng Wang , Yan Gao , Yi Wu , Yao Hu , Yin Xu , Wei Wang , Hao Wang , Enhong Chen

We introduce Refusal Steering, an inference-time method to exercise fine-grained control over Large Language Models refusal behaviour on politically sensitive topics without retraining. We replace fragile pattern-based refusal detection…

Computation and Language · Computer Science 2026-02-25 Iker García-Ferrero , David Montero , Roman Orus

Retrieval-Augmented Generation (RAG) integrates large language models (LLMs) with external sources, but unresolved contradictions in retrieved evidence often lead to hallucinations and legally unsound outputs. Benchmarks currently used for…

Artificial Intelligence · Computer Science 2025-10-14 Ananya Mantravadi , Shivali Dalmia , Olga Pospelova , Abhishek Mukherji , Nand Dave , Anudha Mittal

Prior work argues that refusal in large language models is mediated by a single activation-space direction, enabling effective steering and ablation. We show that this account is incomplete. Across eleven categories of refusal and…

Computation and Language · Computer Science 2026-02-03 Faaiz Joad , Majd Hawasly , Sabri Boughorbel , Nadir Durrani , Husrev Taha Sencar

Contemporary generative recommendation systems face significant challenges in handling multimodal data, eliminating algorithmic biases, and providing transparent decision-making processes. This paper introduces an enhanced generative…

Information Retrieval · Computer Science 2025-10-03 Bo Ma , Hang Li , ZeHua Hu , XiaoFan Gui , LuYao Liu , Simon Lau

Retrieval-augmented generation (RAG) has emerged as a promising approach to enhance the performance of large language models (LLMs) in knowledge-intensive tasks such as those from medical domain. However, the sensitive nature of the medical…

Computation and Language · Computer Science 2024-11-15 Nghia Trung Ngo , Chien Van Nguyen , Franck Dernoncourt , Thien Huu Nguyen

Large language models (LLMs) have demonstrated remarkable capabilities across a wide range of tasks, yet they often refuse to answer legitimate queries--a phenomenon known as overrefusal. Overrefusal typically stems from over-conservative…

Artificial Intelligence · Computer Science 2025-09-18 Licheng Pan , Yongqi Tong , Xin Zhang , Xiaolu Zhang , Jun Zhou , Zhixuan Chu

This paper focuses on the dynamic optimization of the Retrieval-Augmented Generation (RAG) architecture. It proposes a state-aware dynamic knowledge retrieval mechanism to enhance semantic understanding and knowledge scheduling efficiency…

Computation and Language · Computer Science 2025-04-29 Jacky He , Guiran Liu , Binrong Zhu , Hanlu Zhang , Hongye Zheng , Xiaokai Wang

Retrieval-Augmented Generation (RAG) grounds large language models (LLMs) in external evidence, but fails when retrieved sources conflict or contain outdated or subjective information. Prior work address these issues independently but lack…

Computation and Language · Computer Science 2025-12-19 Shubham Mishra , Samyek Jain , Gorang Mehrishi , Shiv Tiwari , Harsh Sharma , Pratik Narang , Dhruv Kumar

Retrieval-Augmented Generation (RAG) is a technique that enhances the capabilities of large language models (LLMs) by incorporating external knowledge sources. This method addresses common LLM limitations, including outdated information and…

Computation and Language · Computer Science 2024-07-16 Yuanjie Lyu , Zhiyu Li , Simin Niu , Feiyu Xiong , Bo Tang , Wenjin Wang , Hao Wu , Huanyong Liu , Tong Xu , Enhong Chen

Reliable Large Language Models (LLMs) should abstain when confidence is insufficient. However, prior studies often treat refusal as a generic "I don't know'', failing to distinguish input-level ambiguity (data uncertainty) from capability…

Computation and Language · Computer Science 2026-04-21 Jingyi Ren , Ante Wang , Yunghwei Lai , Xiaolong Wang , Linlu Gong , Weitao Li , Weizhi Ma , Yang Liu

Large Language Models (LLMs) excel at reasoning and generation but are inherently limited by static pretraining data, resulting in factual inaccuracies and weak adaptability to new information. Retrieval-Augmented Generation (RAG) addresses…

Computation and Language · Computer Science 2025-11-03 Qi Luo , Xiaonan Li , Yuxin Wang , Tingshuo Fan , Yuan Li , Xinchi Chen , Xipeng Qiu

Large Language Models (LLMs) often exhibit knowledge disparities across languages. Encouraging LLMs to \textit{abstain} when faced with knowledge gaps is a promising strategy to reduce hallucinations in multilingual settings. Current…

Computation and Language · Computer Science 2025-06-04 Yuxi Sun , Aoqi Zuo , Wei Gao , Jing Ma

While recent studies have looked into the abilities of large language models in various benchmark tasks, including question generation, reading comprehension, multilingual and etc, there have been few studies looking into the…

Computation and Language · Computer Science 2023-10-24 Jiao Sun , Yufei Tian , Wangchunshu Zhou , Nan Xu , Qian Hu , Rahul Gupta , John Frederick Wieting , Nanyun Peng , Xuezhe Ma

Since many real-world documents combine textual and tabular data, robust Retrieval Augmented Generation (RAG) systems are essential for effectively accessing and analyzing such content to support complex reasoning tasks. Therefore, this…

Information Retrieval · Computer Science 2026-01-19 Jan Strich , Enes Kutay Isgorur , Maximilian Trescher , Chris Biemann , Martin Semmann

Retrieval-Augmented Generation (RAG) enhances recency and factuality in answers. However, existing evaluations rarely test how well these systems cope with real-world noise, conflicting between internal and external retrieved contexts, or…

Computation and Language · Computer Science 2025-10-29 Yixiao Zeng , Tianyu Cao , Danqing Wang , Xinran Zhao , Zimeng Qiu , Morteza Ziyadi , Tongshuang Wu , Lei Li

Large Language Models (LLMs) have demonstrated remarkable proficiency in vulnerability detection. However, a critical reliability gap persists: models frequently yield correct detection verdicts based on hallucinated logic or superficial…

Cryptography and Security · Computer Science 2026-02-09 Li Lu , Yanjie Zhao , Hongzhou Rao , Kechi Zhang , Haoyu Wang

Large pretrained language models can easily produce toxic or biased content, which is prohibitive for practical use. In order to detect such toxic generations, existing methods rely on templates, real-world data extraction, crowdsourcing…

Computation and Language · Computer Science 2022-12-06 Zhexin Zhang , Jiale Cheng , Hao Sun , Jiawen Deng , Fei Mi , Yasheng Wang , Lifeng Shang , Minlie Huang

Recent advancements in large language models (LLMs) have significantly enhanced text generation capabilities, yet evaluating their performance in generative writing remains a challenge. Existing benchmarks primarily focus on generic text…

Artificial Intelligence · Computer Science 2025-12-01 Yuning Wu , Jiahao Mei , Ming Yan , Chenliang Li , Shaopeng Lai , Yuran Ren , Zijia Wang , Ji Zhang , Mengyue Wu , Qin Jin , Fei Huang
‹ Prev 1 4 5 6 7 8 10 Next ›