English
Related papers

Related papers: Autoregressive Ranking: Bridging the Gap Between D…

200 papers

Large Language Models (LLMs) have transformed listwise document reranking by enabling global reasoning over candidate sets, yet single models often struggle to balance fine-grained relevance scoring with holistic cross-document analysis. We…

Computation and Language · Computer Science 2025-08-26 Abdelrahman Abdallah , Jamshid Mozafari , Bhawna Piryani , Adam Jatowt

Dense retrieval is a crucial task in Information Retrieval (IR), serving as the basis for downstream tasks such as re-ranking and augmenting generation. Recently, large language models (LLMs) have demonstrated impressive semantic…

Information Retrieval · Computer Science 2025-08-20 Hengran Zhang , Keping Bi , Jiafeng Guo , Xiaojie Sun , Shihao Liu , Daiting Shi , Dawei Yin , Xueqi Cheng

Large language model (LLM) based listwise reranking has emerged as the dominant paradigm for achieving state-of-the-art ranking effectiveness in information retrieval. However, its reliance on feeding full passage texts into the LLM…

Information Retrieval · Computer Science 2026-04-27 Xiaojie Ke , Shuai Zhang , Liansheng Sun , Yongjin Wang , Hengjun Jiang , Xiangkun Liu , Cunxin Gu , Jian Xu , Guanjun Jiang

Knowledge-intensive language tasks require NLP systems to both provide the correct answer and retrieve supporting evidence for it in a given corpus. Autoregressive language models are emerging as the de-facto standard for generating…

Computation and Language · Computer Science 2022-04-25 Michele Bevilacqua , Giuseppe Ottaviano , Patrick Lewis , Wen-tau Yih , Sebastian Riedel , Fabio Petroni

Supervised ranking methods based on bi-encoder or cross-encoder architectures have shown success in multi-stage text ranking tasks, but they require large amounts of relevance judgments as training data. In this work, we propose Listwise…

Information Retrieval · Computer Science 2023-05-04 Xueguang Ma , Xinyu Zhang , Ronak Pradeep , Jimmy Lin

Large Language Models (LLMs) have shown strong capabilities in document re-ranking, a key component in modern Information Retrieval (IR) systems. However, existing LLM-based approaches face notable limitations, including ranking…

Information Retrieval · Computer Science 2025-10-03 Pinhuan Wang , Zhiqiu Xia , Chunhua Liao , Feiyi Wang , Hang Liu

A new trend uses LLMs as dense text encoders via contrastive learning. However, since LLM embeddings predict the probability distribution of the next token, they are inherently generative and distributive, conflicting with contrastive…

Computation and Language · Computer Science 2025-10-17 Jingcheng Deng , Zhongtao Jiang , Liang Pang , Liwei Chen , Kun Xu , Zihao Wei , Huawei Shen , Xueqi Cheng

We present Autoregressive Representation Alignment (ARRA), a new training framework that unlocks global-coherent text-to-image generation in autoregressive LLMs without architectural modifications. Different from prior works that require…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Xing Xie , Jiawei Liu , Ziyue Lin , Huijie Fan , Zhi Han , Yandong Tang , Liangqiong Qu

Large Language Models (LLMs) demonstrate robust capabilities across various fields, leading to a paradigm shift in LLM-enhanced Recommender System (RS). Research to date focuses on point-wise and pair-wise recommendation paradigms, which…

Information Retrieval · Computer Science 2024-09-30 Wen-Shuo Chao , Zhi Zheng , Hengshu Zhu , Hao Liu

Decoding-based regression, which reformulates regression as a sequence generation task, has emerged as a promising paradigm of applying large language models for numerical prediction. However, its progress is hindered by the misalignment…

Machine Learning · Computer Science 2025-12-09 Ming Chen , Sheng Tang , Rong-Xi Tan , Ziniu Li , Jiacheng Chen , Ke Xue , Chao Qian

Document retrieval is a key stage of standard Web search engines. Existing dual-encoder dense retrievers obtain representations for questions and documents independently, allowing for only shallow interactions between them. To overcome this…

Computation and Language · Computer Science 2023-05-17 Noah Ziems , Wenhao Yu , Zhihan Zhang , Meng Jiang

The prevailing assumption of an exponential decay in large language model (LLM) reliability with sequence length, predicated on independent per-token error probabilities, posits an inherent limitation for long autoregressive outputs. Our…

Computation and Language · Computer Science 2026-05-07 Mikhail L. Arbuzov , Sisong Bei , Ziwei Dong , Dmitri Kalaev , Alexey A. Shvets

Employing LLMs for visual generation has recently become a research focus. However, the existing methods primarily transfer the LLM architecture to visual generation but rarely investigate the fundamental differences between language and…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Teng Hu , Jiangning Zhang , Ran Yi , Jieyu Weng , Yabiao Wang , Xianfang Zeng , Zhucun Xue , Lizhuang Ma

Autoregressive models (ARMs) have become the workhorse for sequence generation tasks, since many problems can be modeled as next-token prediction. While there appears to be a natural ordering for text (i.e., left-to-right), for many data…

Machine Learning · Computer Science 2025-07-15 Zhe Wang , Jiaxin Shi , Nicolas Heess , Arthur Gretton , Michalis K. Titsias

Retrieval-augmented generation (RAG) with large language models (LLMs) is especially valuable in specialized domains, where precision is critical. To more specialize the LLMs into a target domain, domain-specific RAG has recently been…

Computation and Language · Computer Science 2025-02-24 Juntae Lee , Jihwan Bang , Seunghan Yang , Kyuhong Shim , Simyung Chang

Dense retrieval calls for discriminative embeddings to represent the semantic relationship between query and document. It may benefit from the using of large language models (LLMs), given LLMs' strong capability on semantic understanding.…

Computation and Language · Computer Science 2025-11-25 Zheng Liu , Chaofan Li , Shitao Xiao , Yingxia Shao , Defu Lian

Large language model (LLM) decoding involves generating a sequence of tokens based on a given context, where each token is predicted one at a time using the model's learned probabilities. The typical autoregressive decoding method requires…

Computation and Language · Computer Science 2024-08-20 Xukun Liu , Bowen Lei , Ruqi Zhang , Dongkuan Xu

Efficiency, as a critical practical challenge for LLM-driven agentic and reasoning systems, is increasingly constrained by the inherent latency of autoregressive (AR) decoding. Speculative decoding mitigates this cost through a draft-verify…

Machine Learning · Computer Science 2025-12-18 Zicong Cheng , Guo-Wei Yang , Jia Li , Zhijie Deng , Meng-Hao Guo , Shi-Min Hu

The efficiency of large language models (LLMs) is fundamentally limited by their sequential, token-by-token generation process. We argue that overcoming this bottleneck requires a new design axis for LLM scaling: increasing the semantic…

Computation and Language · Computer Science 2025-11-03 Chenze Shao , Darren Li , Fandong Meng , Jie Zhou

Dense retrieval (DR) has shown promising results in information retrieval. In essence, DR requires high-quality text representations to support effective search in the representation space. Recent studies have shown that pre-trained…

Information Retrieval · Computer Science 2022-08-23 Xinyu Ma , Ruqing Zhang , Jiafeng Guo , Yixing Fan , Xueqi Cheng
‹ Prev 1 2 3 10 Next ›