English
Related papers

Related papers: Budgeted Embedding Table For Recommender Systems

200 papers

Recommendation systems (RecSys) suggest items to users by predicting their preferences based on historical data. Typical RecSys handle large embedding tables and many embedding table related operations. The memory size and bandwidth of the…

Hardware Architecture · Computer Science 2022-02-22 Mengyuan Li , Ann Franchesca Laguna , Dayane Reis , Xunzhao Yin , Michael Niemier , Xiaobo Sharon Hu

Sequential recommendation models have achieved state-of-the-art performance using self-attention mechanism. It has since been found that moving beyond only using item ID and positional embeddings leads to a significant accuracy boost when…

Information Retrieval · Computer Science 2024-09-10 Linsey Pang , Amir Hossein Raffiee , Wei Liu , Keld Lundgaard

Low rank matrix factorisation is often used in recommender systems as a way of extracting latent features. When dealing with large and sparse datasets, traditional recommendation algorithms face the problem of acquiring large, unrestrained,…

Machine Learning · Computer Science 2018-07-17 Shuai Jiang , Kan Li , Richard Yi Da Xu

As a pivotal tool to alleviate the information overload problem, recommender systems aim to predict user's preferred items from millions of candidates by analyzing observed user-item relations. As for alleviating the sparsity and cold start…

Information Retrieval · Computer Science 2022-05-24 Yue Deng

Large-scale industrial recommender systems are usually confronted with computational problems due to the enormous corpus size. To retrieve and recommend the most relevant items to users under response time limits, resorting to an efficient…

Information Retrieval · Computer Science 2019-11-21 Han Zhu , Daqing Chang , Ziru Xu , Pengye Zhang , Xiang Li , Jie He , Han Li , Jian Xu , Kun Gai

Behavioral patterns captured in embeddings learned from interaction data are pivotal across various stages of production recommender systems. However, in the initial retrieval stage, practitioners face an inherent tradeoff between embedding…

Information Retrieval · Computer Science 2026-02-11 Vojtěch Vančura , Martin Spišák , Rodrigo Alves , Ladislav Peška

Recommender systems are an essential component of e-commerce marketplaces, helping consumers navigate massive amounts of inventory and find what they need or love. In this paper, we present an approach for generating personalized item…

Information Retrieval · Computer Science 2021-02-12 Tian Wang , Yuri M. Brovman , Sriganesh Madhvanath

Federated recommender systems enable collaborative model training while keeping user interaction data local and sharing only essential model parameters, thereby mitigating privacy risks. However, existing methods overlook a critical issue,…

Machine Learning · Computer Science 2026-03-13 Fengyuan Yu , Xiaohua Feng , Yuyuan Li , Changwang Zhang , Jun Wang , Chaochao Chen

User embeddings (vectorized representations of a user) are essential in recommendation systems. Numerous approaches have been proposed to construct a representation for the user in order to find similar items for retrieval tasks, and they…

Information Retrieval · Computer Science 2023-05-29 Hui Shi , Yupeng Gu , Yitong Zhou , Bo Zhao , Sicun Gao , Jishen Zhao

One of the main challenges in recommender systems is data sparsity which leads to high variance. Several attempts have been made to improve the bias-variance trade-off using auxiliary information. In particular, document modeling-based…

Information Retrieval · Computer Science 2021-09-14 Meysam Varasteh , Mehdi Soleiman Nejad , Hadi Moradi , Mohammad Amin Sadeghi , Ahmad Kalhor

Recommendation systems are highly interested in technology companies nowadays. The businesses are constantly growing users and products, causing the number of users and items to continuously increase over time, to very large numbers.…

Information Retrieval · Computer Science 2024-01-19 Vu Hong Quan , Le Hoang Ngan , Le Minh Duc , Nguyen Tran Ngoc Linh , Hoang Quynh-Le

Sequential recommendation models have been widely adopted for modeling user behavior. Existing approaches typically construct user interaction sequences by sorting items according to timestamps and then model user preferences from…

Information Retrieval · Computer Science 2026-04-16 Haolin Zhang , Longtao Xiao , Guohao Cai , Ruixuan Li , Xiu Li

Bundle recommendation approaches offer users a set of related items on a particular topic. The current state-of-the-art (SOTA) method utilizes contrastive learning to learn representations at both the bundle and item levels. However, due to…

Information Retrieval · Computer Science 2023-11-29 Xiaoyu Du , Kun Qian , Yunshan Ma , Xinguang Xiang

Feature embeddings are one of the most essential steps when training deep learning based Click-Through Rate prediction models, which map high-dimensional sparse features to dense embedding vectors. Classic human-crafted embedding size…

Information Retrieval · Computer Science 2022-08-18 Tesi Xiao , Xia Xiao , Ming Chen , Youlong Chen

We propose a new technique for computational language representation called elementwise embedding, in which a material (semantic unit) is abstracted into a horizontal concatenation of lower-dimensional element (character) embeddings. While…

Computation and Language · Computer Science 2023-02-28 Dunam Kim , Jeeeun Kim

Embedding tables dominate industrial-scale recommendation model sizes, using up to terabytes of memory. A popular and the largest publicly available machine learning MLPerf benchmark on recommendation data is a Deep Learning Recommendation…

Machine Learning · Computer Science 2022-07-25 Aditya Desai , Anshumali Shrivastava

In recent times Large Language Models have exhibited tremendous capabilities, especially in the areas of mathematics, code generation and general-purpose reasoning. However for specialized domains especially in applications that require…

Artificial Intelligence · Computer Science 2024-05-06 Sujit Khanna , Shishir Subedi

Multi-behavior recommendation (MBR) aims to improve the performance w.r.t. the target behavior (i.e., purchase) by leveraging auxiliary behaviors (e.g., click, favourite). However, in real-world scenarios, a recommendation method often…

Information Retrieval · Computer Science 2026-01-13 Wenhao Lai , Weike Pan , Zhong Ming

Sequential Recommendation (SR) captures users' dynamic preferences by modeling how users transit among items. However, SR models that utilize only single type of behavior interaction data encounter performance degradation when the sequences…

Information Retrieval · Computer Science 2024-02-23 Jiajie Su , Chaochao Chen , Zibin Lin , Xi Li , Weiming Liu , Xiaolin Zheng

Sequential recommendation aims to provide users with personalized suggestions based on their historical interactions. When training sequential models, padding is a widely adopted technique for two main reasons: 1) The vast majority of…

Information Retrieval · Computer Science 2025-07-16 Yizhou Dang , Yuting Liu , Enneng Yang , Guibing Guo , Linying Jiang , Jianzhe Zhao , Xingwei Wang