English
Related papers

Related papers: RaFe: Ranking Feedback Improves Query Rewriting fo…

200 papers

Recent large language models (LLM) are leveraging human feedback to improve their generation quality. However, human feedback is costly to obtain, especially during inference. In this work, we propose LLMRefine, an inference time…

Computation and Language · Computer Science 2024-10-28 Wenda Xu , Daniel Deutsch , Mara Finkelstein , Juraj Juraska , Biao Zhang , Zhongtao Liu , William Yang Wang , Lei Li , Markus Freitag

Language Models (LMs) memorize a vast amount of factual knowledge, exhibiting strong performance across diverse tasks and domains. However, it has been observed that the performance diminishes when dealing with less-popular or low-frequency…

Computation and Language · Computer Science 2024-12-03 Heydar Soudani , Evangelos Kanoulas , Faegheh Hasibi

Recent studies have demonstrated that large language models (LLMs) exhibit significant biases in evaluation tasks, particularly in preferentially rating and favoring self-generated content. However, the extent to which this bias manifests…

Computation and Language · Computer Science 2025-12-09 Yen-Shan Chen , Jing Jin , Peng-Ting Kuo , Chao-Wei Huang , Yun-Nung Chen

Risk and Quality (R&Q) assurance in highly regulated industries requires constant navigation of complex regulatory frameworks, with employees handling numerous daily queries demanding accurate policy interpretation. Traditional methods…

Large language models (LLMs) have revolutionized natural language processing, yet hallucinations in knowledge-intensive tasks remain a critical challenge. Retrieval-augmented generation (RAG) addresses this by integrating external…

Computation and Language · Computer Science 2026-02-17 Zhipeng Song , Xiangyu Kong , Xinrui Bao , Yizhi Zhou , Jiulong Jiao , Sitong Liu , Yuhang Zhou , Heng Qi

Retrieval-Augmented Generation (RAG) systems typically rely on a single fixed retriever, despite growing evidence that no single retriever performs optimally across all query types. In this paper, we explore a query routing approach that…

Computation and Language · Computer Science 2026-04-21 To Eun Kim , Fernando Diaz

Despite the popularity of retrieval-augmented generation (RAG) as a solution for grounded QA in both academia and industry, current RAG methods struggle with questions where the necessary information is distributed across many documents or…

Computation and Language · Computer Science 2025-11-11 Nathan Scales , Nathanael Schärli , Olivier Bousquet

Recent studies have proposed leveraging Large Language Models (LLMs) as information retrievers through query rewriting. However, for challenging corpora, we argue that enhancing queries alone is insufficient for robust semantic matching;…

Information Retrieval · Computer Science 2025-06-24 Jingming Liu , Yumeng Li , Wei Shi , Yao-Xiang Ding , Hui Su , Kun Zhou

Since large language models (LLMs) have a tendency to generate factually inaccurate output, retrieval-augmented generation (RAG) has gained significant attention as a key means to mitigate this downside of harnessing only LLMs. However,…

Computation and Language · Computer Science 2025-12-18 Youmin Ko , Sungjong Seo , Hyunjoon Kim

Reinforcement learning (RL) has demonstrated potential in enhancing the reasoning capabilities of large language models (LLMs), but such training typically demands substantial efforts in creating and annotating data. In this work, we…

Computation and Language · Computer Science 2025-10-06 Hangfan Zhang , Siyuan Xu , Zhimeng Guo , Huaisheng Zhu , Shicheng Liu , Xinrun Wang , Qiaosheng Zhang , Yang Chen , Peng Ye , Lei Bai , Shuyue Hu

In the Retrieval-Augmented Generation (RAG) system, advanced Large Language Models (LLMs) have emerged as effective Query Likelihood Models (QLMs) in an unsupervised way, which re-rank documents based on the probability of generating the…

Computation and Language · Computer Science 2024-12-23 Xiaowei Yuan , Zhao Yang , Yequan Wang , Jun Zhao , Kang Liu

The application of large language models (LLMs) in recommendation systems has recently gained traction. Traditional recommendation systems often lack explainability and suffer from issues such as popularity bias. Previous research has also…

Information Retrieval · Computer Science 2025-12-04 Yaqi Wang , Haojia Sun , Shuting Zhang

Reward models (RMs) play a critical role in aligning language models through the process of reinforcement learning from human feedback. RMs are trained to predict a score reflecting human preference, which requires significant time and cost…

Computation and Language · Computer Science 2024-10-21 Zihuiwen Ye , Fraser Greenlee-Scott , Max Bartolo , Phil Blunsom , Jon Ander Campos , Matthias Gallé

This work presents a novel architecture for building Retrieval-Augmented Generation (RAG) systems to improve Question Answering (QA) tasks from a target corpus. Large Language Models (LLMs) have revolutionized the analyzing and generation…

Computation and Language · Computer Science 2025-01-09 Binita Saha , Utsha Saha , Muhammad Zubair Malik

Automatic speech recognition (ASR) systems have achieved strong performance on general transcription tasks. However, they continue to struggle with recognizing rare named entities and adapting to domain mismatches. In contrast, large…

Computation and Language · Computer Science 2025-08-21 Shaoshi Ling , Guoli Ye

Reranking is a critical stage in contemporary information retrieval (IR) systems, improving the relevance of the user-presented final results by honing initial candidate sets. This paper is a thorough guide to examine the changing reranker…

Information Retrieval · Computer Science 2025-12-19 Tejul Pandit , Sakshi Mahendru , Meet Raval , Dhvani Upadhyay

Recently, large language models (LLMs) have exhibited significant progress in language understanding and generation. By leveraging textual features, customized LLMs are also applied for recommendation and demonstrate improvements across…

Information Retrieval · Computer Science 2023-11-07 Zhenrui Yue , Sara Rabhi , Gabriel de Souza Pereira Moreira , Dong Wang , Even Oldridge

In the multi-turn interaction schema, large language models (LLMs) can leverage user feedback to enhance the quality and relevance of their responses. However, evaluating an LLM's ability to incorporate user refutation feedback is crucial…

Computation and Language · Computer Science 2025-02-26 Jianhao Yan , Yun Luo , Yue Zhang

Large pre-trained language models have been shown to store factual knowledge in their parameters, and achieve state-of-the-art results when fine-tuned on downstream NLP tasks. However, their ability to access and precisely manipulate…

The deployment of large language models (LLMs) like ChatGPT and Gemini has shown their powerful natural language generation capabilities. However, these models can inadvertently learn and retain sensitive information and harmful content…

Cryptography and Security · Computer Science 2025-10-14 Shang Wang , Tianqing Zhu , Dayong Ye , Wanlei Zhou