English
Related papers

Related papers: Equip Pre-ranking with Target Attention by Residua…

200 papers

Generative retrieval (GR) has emerged as a transformative paradigm in search and recommender systems, leveraging numeric-based identifier representations to enhance efficiency and generalization. Notably, methods like TIGER employing…

In the era of large language models (LLMs), fine-tuning pretrained models has become ubiquitous. Yet the theoretical underpinning remains an open question. A central question is why only a few epochs of fine-tuning are typically sufficient…

Machine Learning · Statistics 2026-02-17 Zexuan Sun , Garvesh Raskutti

Real-word search and recommender systems usually adopt a multi-stage ranking architecture, including matching, pre-ranking, ranking, and re-ranking. Previous works mainly focus on the ranking stage while very few focus on the pre-ranking…

Information Retrieval · Computer Science 2022-07-08 Yue Cao , XiaoJiang Zhou , Peihao Huang , Yao Xiao , Dayao Chen , Sheng Chen

Modern sequential recommender systems commonly use transformer-based models for next-item prediction. While these models demonstrate a strong balance between efficiency and quality, integrating interleaving features - such as the query…

Information Retrieval · Computer Science 2025-08-13 Andrii Dzhoha , Alisa Mironenko , Evgeny Labzin , Vladimir Vlasov , Maarten Versteegh , Marjan Celikik

Technical troubleshooting in enterprise environments often involves navigating diverse, heterogeneous data sources to resolve complex issues effectively. This paper presents a novel agentic AI solution built on a Weighted…

Artificial Intelligence · Computer Science 2024-12-18 Rajat Khanda

Significant efforts have been expended in the research and development of a database management system (DBMS) that has a wide range of applications for managing an enormous collection of multisource, heterogeneous, complex, or growing data.…

Databases · Computer Science 2021-04-01 Chunkai Zhang , Zilin Du , Quanjian Dai , Wensheng Gan , Jian Weng , Philip S. Yu

Ranking models play a crucial role in enhancing overall accuracy of text retrieval systems. These multi-stage systems typically utilize either dense embedding models or sparse lexical indices to retrieve relevant passages based on a given…

Information Retrieval · Computer Science 2024-09-13 Gabriel de Souza P. Moreira , Ronay Ak , Benedikt Schifferer , Mengyao Xu , Radek Osmulski , Even Oldridge

The rapid increase in the number of parameters in large language models (LLMs) has significantly increased the cost involved in fine-tuning and retraining LLMs, a necessity for keeping models up to date and improving accuracy.…

Hardware Architecture · Computer Science 2024-12-17 Michael Shen , Muhammad Umar , Kiwan Maeng , G. Edward Suh , Udit Gupta

Prefilling computational costs pose a significant bottleneck for Large Language Models (LLMs) and Large Multimodal Models (LMMs) in long-context settings. While token pruning reduces sequence length, prior methods rely on heuristics that…

Artificial Intelligence · Computer Science 2026-05-27 Yujie Chen , Tailai Chen , Yifeng Gao , Zoe Wanying He , Yijue Xu , Shaobo Wang , Linfeng Zhang

User response prediction is essential in industrial recommendation systems, such as online display advertising. Among all the features in recommendation models, user behaviors are among the most critical. Many works have revealed that a…

Information Retrieval · Computer Science 2024-07-08 Haolin Zhou , Junwei Pan , Xinyi Zhou , Xihua Chen , Jie Jiang , Xiaofeng Gao , Guihai Chen

Multi-target regression is concerned with the prediction of multiple continuous target variables using a shared set of predictors. Two key challenges in multi-target regression are: (a) modelling target dependencies and (b) scalability to…

Machine Learning · Computer Science 2020-03-24 Eleftherios Spyromitros-Xioufis , Konstantinos Sechidis , Ioannis Vlahavas

Many latent (factorized) models have been proposed for recommendation tasks like collaborative filtering and for ranking tasks like document or image retrieval and annotation. Common to all those methods is that during inference the items…

Machine Learning · Computer Science 2012-10-19 Jason Weston , John Blitzer

Recurrent neural networks (RNNs) with deep test-time memorization modules, such as Titans and TTT, represent a promising, linearly-scaling paradigm distinct from Transformers. While these expressive models do not yet match the peak…

Machine Learning · Computer Science 2025-11-11 Zeman Li , Ali Behrouz , Yuan Deng , Peilin Zhong , Praneeth Kacham , Mahdi Karami , Meisam Razaviyayn , Vahab Mirrokni

In Sequential Recommendation Systems (SRSs), Transformer models have demonstrated remarkable performance but face computational and memory cost challenges, especially when modeling long-term user behavior sequences. Due to its quadratic…

Information Retrieval · Computer Science 2026-03-25 Juntao Hu , Wei Zhou , Haini Cai , Xiao Du , Huayi Shen , Junhao Wen

With the rapid advancement of Transformer-based Large Language Models (LLMs), generative recommendation has shown great potential in enhancing both the accuracy and semantic understanding of modern recommender systems. Compared to LLMs, the…

Information Retrieval · Computer Science 2025-08-19 Xiang Gao , Tianyuan Liu , Yisha Li , Jingxin Liu , Lexi Gao , Xin Li , Haiyang Lu , Liyin Hong

Large penetration of renewable energy sources (RESs) brings huge uncertainty into the electricity markets. The current deterministic clearing approach in the day-ahead (DA) market, where RESs participate based on expected production, has…

Systems and Control · Electrical Eng. & Systems 2025-08-07 Yufan Zhang , Honglin Wen , Yuexin Bian , Yuanyuan Shi

Reranking, as the final stage of multi-stage recommender systems, refines the initial lists to maximize the total utility. With the development of multimedia and user interface design, the recommendation page has evolved to a multi-list…

Information Retrieval · Computer Science 2022-11-18 Yunjia Xi , Jianghao Lin , Weiwen Liu , Xinyi Dai , Weinan Zhang , Rui Zhang , Ruiming Tang , Yong Yu

Industrial recommender systems face two fundamental limitations under the log-driven paradigm: (1) knowledge poverty in ID-based item representations that causes brittle interest modeling under data sparsity, and (2) systemic blindness to…

The review-based recommender systems are commonly utilized to measure users preferences towards different items. In this paper, we focus on addressing three main problems existing in the review-based methods. Firstly, these methods suffer…

Information Retrieval · Computer Science 2020-12-14 Yuexin Wu , Tianyu Gao , Sihao Wang , Zhongmin Xiong

This paper presents the submission of the UDInfo team to the SIGIR 2025 LiveRAG Challenge. We introduce PreQRAG, a Retrieval Augmented Generation (RAG) architecture designed to improve retrieval and generation quality through targeted…

Information Retrieval · Computer Science 2025-06-24 Damian Martinez , Catalina Riano , Hui Fang