English
Related papers

Related papers: Context Aware Query Rewriting for Text Rankers usi…

200 papers

The context window of large language models (LLMs) has been extended significantly in recent years. However, while the context length that the LLM can process has grown, the capability of the model to accurately reason over that context…

Computation and Language · Computer Science 2024-10-07 Huayang Li , Pat Verga , Priyanka Sen , Bowen Yang , Vijay Viswanathan , Patrick Lewis , Taro Watanabe , Yixuan Su

Long-context language models (LCLMs) have exhibited impressive capabilities in long-context understanding tasks. Among these, long-context referencing -- a crucial task that requires LCLMs to attribute items of interest to specific parts of…

Computation and Language · Computer Science 2025-08-05 Junjie Wu , Gefei Gu , Yanan Zheng , Dit-Yan Yeung , Arman Cohan

Large language models (LLMs) enhanced with retrieval-augmented generation (RAG) have introduced a new paradigm for web search. However, the limited context awareness of LLMs degrades their performance on RAG tasks. Existing methods to…

Computation and Language · Computer Science 2024-10-08 Tao Tan , Yining Qian , Ang Lv , Hongzhan Lin , Songhao Wu , Yongbo Wang , Feng Wang , Jingtong Wu , Xin Lu , Rui Yan

Current LLM agents typically lack instance-level context, which comprises concrete facts such as environment structure, system configurations, and local mechanics. Consequently, existing methods are forced to intertwine exploration with…

Computation and Language · Computer Science 2026-01-14 Kuntai Cai , Juncheng Liu , Xianglin Yang , Zhaojie Niu , Xiaokui Xiao , Xing Chen

Large language models (LLMs) often fail to scale their performance on long-context tasks performance in line with the context lengths they support. This gap is commonly attributed to retrieval failures -- the models' inability to identify…

Computation and Language · Computer Science 2025-10-08 Yufeng Du , Minyang Tian , Srikanth Ronanki , Subendhu Rongali , Sravan Bodapati , Aram Galstyan , Azton Wells , Roy Schwartz , Eliu A Huerta , Hao Peng

Large language models (LLMs) are increasingly integral to information retrieval (IR), powering ranking, evaluation, and AI-assisted content creation. This widespread adoption necessitates a critical examination of potential biases arising…

Information Retrieval · Computer Science 2025-07-11 Krisztian Balog , Donald Metzler , Zhen Qin

Topic relevance between query and document is a very important part of social search, which can evaluate the degree of matching between document and user's requirement. In most social search scenarios such as Dianping, modeling search…

Information Retrieval · Computer Science 2025-12-11 Yizhu Liu , Ran Tao , Shengyu Guo , Yifan Yang

Scientific retrieval is essential for advancing scientific knowledge discovery. Within this process, document reranking plays a critical role in refining first-stage retrieval results. However, standard LLM listwise reranking faces…

Information Retrieval · Computer Science 2025-08-19 Runchu Tian , Xueqiang Xu , Bowen Jin , SeongKu Kang , Jiawei Han

Despite the popularity of the large language models (LLMs), their application to machine translation is relatively underexplored, especially in context-aware settings. This work presents a literature review of context-aware translation with…

Computation and Language · Computer Science 2025-06-10 Ramakrishna Appicharla , Baban Gain , Santanu Pal , Asif Ekbal

Large Language Models (LLMs) are limited by their parametric knowledge, leading to hallucinations in knowledge-extensive tasks. To address this, Retrieval-Augmented Generation (RAG) incorporates external document chunks to expand LLM…

Computation and Language · Computer Science 2025-04-30 Zhonghao Li , Xuming Hu , Aiwei Liu , Kening Zheng , Sirui Huang , Hui Xiong

Large language models (LLMs) have shown impressive zero-shot capabilities in various document reranking tasks. Despite their successful implementations, there is still a gap in existing literature on their effectiveness in low-resource…

Information Retrieval · Computer Science 2023-12-27 Mofetoluwa Adeyemi , Akintunde Oladipo , Ronak Pradeep , Jimmy Lin

In-context learning (ICL) of large language models (LLMs) has attracted increasing attention in the community where LLMs make predictions only based on instructions augmented with a few examples. Existing example selection methods for ICL…

Computation and Language · Computer Science 2024-08-26 Haowei Du , Dongyan Zhao

Large language models (LLMs) have recently shown strong reasoning abilities in domains like mathematics, coding, and scientific problem-solving, yet their potential for ranking tasks, where prime examples include retrieval, recommender…

Information Retrieval · Computer Science 2025-10-17 Tao Feng , Zhigang Hua , Zijie Lei , Yan Xie , Shuang Yang , Bo Long , Jiaxuan You

Authorship attribution (AA) is the task of identifying the most likely author of a query document from a predefined set of candidate authors. We introduce a two-stage retrieve-and-rerank framework that finetunes LLMs for cross-genre AA.…

Computation and Language · Computer Science 2025-10-21 Shantanu Agarwal , Joel Barry , Steven Fincke , Scott Miller

Can we improve machine translation (MT) with LLMs by rewriting their inputs automatically? Users commonly rely on the intuition that well-written text is easier to translate when using off-the-shelf MT systems. LLMs can rewrite text in many…

Computation and Language · Computer Science 2025-09-03 Dayeon Ki , Marine Carpuat

Recent advancements in long-context language models (LCLMs) promise to transform Retrieval-Augmented Generation (RAG) by simplifying pipelines. With their expanded context windows, LCLMs can process entire knowledge bases and perform…

Computation and Language · Computer Science 2025-06-10 Yifu Qiu , Varun Embar , Yizhe Zhang , Navdeep Jaitly , Shay B. Cohen , Benjamin Han

Conducting literature reviews for scientific papers is essential for understanding research, its limitations, and building on existing work. It is a tedious task which makes an automatic literature review generator appealing. Unfortunately,…

Re-ranking plays a crucial role in modern information search systems by refining the ranking of initial search results to better satisfy user information needs. However, existing methods show two notable limitations in improving user search…

Information Retrieval · Computer Science 2026-05-14 Zihao Guo , Ligang Zhou , Zeyang Tang , Feicheng Li , Ying Nie , Zhiming Peng , Qingyun Sun , Jianxin Li

Language models (LMs) have demonstrated remarkable capabilities in NLP, yet adapting them efficiently and robustly to specific tasks remains challenging. As their scale and complexity grow, fine-tuning LMs on labelled data often…

Computation and Language · Computer Science 2025-06-27 Zhengyan Shi

Multimodal Large Language Models (MLLMs) possess intrinsic reasoning and world-knowledge capabilities, yet adapting them for dense retrieval remains challenging. Existing approaches rely on invasive parameter updates, such as full…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Haoran Lou , Ziyan Liu , Chunxiao Fan , Yuexin Wu , Yue Ming , Hao Wu , Kai Zuo , Yibo Chen , Xu Tang