English
Related papers

Related papers: From Features to Transformers: Redefining Ranking …

200 papers

A discriminatively trained neural net classifier can fit the training data perfectly if all information about its input other than class membership has been discarded prior to the output layer. Surprisingly, past research has discovered…

Machine Learning · Computer Science 2021-07-23 Piotr Teterwak , Chiyuan Zhang , Dilip Krishnan , Michael C. Mozer

With sequentially stacked self-attention, (optional) encoder-decoder attention, and feed-forward layers, Transformer achieves big success in natural language processing (NLP), and many variants have been proposed. Currently, almost all…

Computation and Language · Computer Science 2021-03-08 Jinhua Zhu , Lijun Wu , Yingce Xia , Shufang Xie , Tao Qin , Wengang Zhou , Houqiang Li , Tie-Yan Liu

Recently, Multi-Scenario Learning (MSL) is widely used in recommendation and retrieval systems in the industry because it facilitates transfer learning from different scenarios, mitigating data sparsity and reducing maintenance cost. These…

Information Retrieval · Computer Science 2023-06-30 Yu Tian , Bofang Li , Si Chen , Xubin Li , Hongbo Deng , Jian Xu , Bo Zheng , Qian Wang , Chenliang Li

Existing approaches typically rely on large-scale fine-tuning to adapt LLMs for information reranking tasks, which is computationally expensive. In this work, we demonstrate that modern LLMs can be effectively adapted using only minimal,…

Computation and Language · Computer Science 2025-10-28 Tingyu Song , Yilun Zhao , Siyue Zhang , Chen Zhao , Arman Cohan

Finding the most relevant person for a job proposal in real time is challenging, especially when resumes are long, structured, and multilingual. In this paper, we propose a re-ranking model based on a new generation of late cross-attention…

Computation and Language · Computer Science 2026-01-19 Warren Jouanneau , Emma Jouffroy , Marc Palyart

Modern recommender systems struggle to effectively utilize the rich, yet high-dimensional and noisy, multi-modal features generated by Large Language Models (LLMs). Treating these features as static inputs decouples them from the core…

Information Retrieval · Computer Science 2025-12-02 Jiahao Tian , Zhenkai Wang

Recommender systems (RS) serve as a fundamental tool for navigating the vast expanse of online information, with deep learning advancements playing an increasingly important role in improving ranking accuracy. Among these, graph neural…

Information Retrieval · Computer Science 2025-02-18 Bin Wu , Yihang Wang , Yuanhao Zeng , Jiawei Liu , Jiashu Zhao , Cheng Yang , Yawen Li , Long Xia , Dawei Yin , Chuan Shi

In this chapter, we consider generative information retrieval evaluation from two distinct but interrelated perspectives. First, large language models (LLMs) themselves are rapidly becoming tools for evaluation, with current research…

Information Retrieval · Computer Science 2025-01-31 Marwah Alaofi , Negar Arabzadeh , Charles L. A. Clarke , Mark Sanderson

Recent studies increasingly explore Large Language Models (LLMs) as a new paradigm for recommendation systems due to their scalability and world knowledge. However, existing work has three key limitations: (1) most efforts focus on…

We develop an algorithm to train individually fair learning-to-rank (LTR) models. The proposed approach ensures items from minority groups appear alongside similar items from majority groups. This notion of fair ranking is based on the…

Machine Learning · Statistics 2021-03-23 Amanda Bower , Hamid Eftekhari , Mikhail Yurochkin , Yuekai Sun

Questions and Answering forums such as Stack Overflow play an important role in supporting software developers in finding answers to queries related to issues such as software errors and bugs. However, searching through a large set of…

Software Engineering · Computer Science 2026-03-10 Fouzi Harrag , Mokdad Khemliche

We present LLaTTE (LLM-Style Latent Transformers for Temporal Events), a scalable transformer architecture for production ads recommendation. Through systematic experiments, we demonstrate that sequence modeling in recommendation systems…

Personalized recommendation requires models that capture sequential user preferences while remaining robust to sparse feedback and semantic ambiguity. Recent work has explored large language models (LLMs) as recommenders and re-rankers, but…

Information Retrieval · Computer Science 2026-04-22 Siqi Liang , Xiawei Wang , Yudi Zhang , Jiaying Zhou

Recommender systems support decisions in various domains ranging from simple items such as books and movies to more complex items such as financial services, telecommunication equipment, and software systems. In this context,…

Information Retrieval · Computer Science 2021-02-15 Alexander Felfernig , Viet-Man Le , Andrei Popescu , Mathias Uta , Thi Ngoc Trang Tran , Müslüum Atas

In the era of information overload, recommendation systems play a pivotal role in filtering data and delivering personalized content. Recent advancements in feature interaction and user behavior modeling have significantly enhanced the…

Information Retrieval · Computer Science 2025-02-20 Hao Wang , Wei Guo , Luankang Zhang , Jin Yao Chin , Yufei Ye , Huifeng Guo , Yong Liu , Defu Lian , Ruiming Tang , Enhong Chen

Graph Neural Networks (GNNs) and their message passing framework that leverages both structural and feature information, have become a standard method for solving graph-based machine learning problems. However, these approaches still…

Machine Learning · Computer Science 2024-11-20 Simon Delarue , Thomas Bonald , Tiphaine Viard

Large-scale supervised data is essential for training modern ranking models, but obtaining high-quality human annotations is costly. Click data has been widely used as a low-cost alternative, and with recent advances in large language…

Information Retrieval · Computer Science 2025-11-11 Lulu Yu , Keping Bi , Jiafeng Guo , Shihao Liu , Shuaiqiang Wang , Dawei Yin , Xueqi Cheng

Multi-label learning has emerged as a crucial paradigm in data analysis, addressing scenarios where instances are associated with multiple class labels simultaneously. With the growing prevalence of multi-label data across diverse…

Computer Vision and Pattern Recognition · Computer Science 2023-09-27 Sadegh Eskandari , Sahar Ghassabi

Transformers have become the predominant architecture in foundation models due to their excellent performance across various domains. However, the substantial cost of scaling these models remains a significant concern. This problem arises…

Recommender systems have traditionally followed modular architectures comprising candidate generation, multi-stage ranking, and re-ranking, each trained separately with supervised objectives and hand-engineered features. While effective in…

Information Retrieval · Computer Science 2025-10-06 Rahul Raja , Anshaj Vats , Arpita Vats , Anirban Majumder