English
Related papers

Related papers: Mem-Rec: Memory Efficient Recommendation System us…

200 papers

Recommendation is crucial for both user experience and company revenue in Meituan as a leading lifestyle company, and generative recommendation models (GRMs) are shown to produce quality recommendations recently. However, existing systems…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-11-25 Yuxiang Wang , Xiao Yan , Chi Ma , Mincong Huang , Xiaoguang Li , Lei Yu , Chuan Liu , Ruidong Han , He Jiang , Bin Yin , Shangyu Chen , Fei Jiang , Xiang Li , Wei Lin , Haowei Han , Bo Du , Jiawei Jiang

The embedding-based representation learning is commonly used in deep learning recommendation models to map the raw sparse features to dense vectors. The traditional embedding manner that assigns a uniform size to all features has two…

Machine Learning · Computer Science 2021-03-12 Siyi Liu , Chen Gao , Yihong Chen , Depeng Jin , Yong Li

To alleviate the problem of information explosion, recommender systems are widely deployed to provide personalized information filtering services. Usually, embedding tables are employed in recommender systems to transform high-dimensional…

Information Retrieval · Computer Science 2024-08-07 Shiwei Li , Huifeng Guo , Xing Tang , Ruiming Tang , Lu Hou , Ruixuan Li , Rui Zhang

Deep Learning Recommendation Models (DLRMs) have gained popularity in recommendation systems due to their effectiveness in handling large-scale recommendation tasks. The embedding layers of DLRMs have become the performance bottleneck due…

Information Retrieval · Computer Science 2024-10-10 Sitian Chen , Haobin Tan , Amelie Chi Zhou , Yusen Li , Pavan Balaji

Deep learning-based recommendation models (DLRMs) are widely deployed in commercial applications to enhance user experience. However, the large and sparse embedding layers in these models impose substantial memory bandwidth bottlenecks due…

Hardware Architecture · Computer Science 2025-09-16 Yu-Hong Lai , Chieh-Lin Tsai , Wen Sheng Lim , Han-Wen Hu , Tei-Wei Kuo , Yuan-Hao Chang

In recent years, recommender systems have advanced rapidly, where embedding learning for users and items plays a critical role. A standard method learns a unique embedding vector for each user and item. However, such a method has two…

Artificial Intelligence · Computer Science 2023-02-13 Yizhou Chen , Guangda Huzhang , Anxiang Zeng , Qingtao Yu , Hui Sun , Heng-yi Li , Jingyi Li , Yabo Ni , Han Yu , Zhiming Zhou

The application of Large Language Models (LLMs) in recommender systems faces key challenges in delivering deep personalization and intelligent reasoning, especially for interactive scenarios. Current methods are often constrained by limited…

Information Retrieval · Computer Science 2025-10-17 Jiani Huang , Xingchen Zou , Lianghao Xia , Qing Li

Recently, large language models (LLMs) have been introduced into recommender systems (RSs), either to enhance traditional recommendation models (TRMs) or serve as recommendation backbones. However, existing LLM-based RSs often do not fully…

Information Retrieval · Computer Science 2025-05-27 Bowen Zheng , Xiaolei Wang , Enze Liu , Xi Wang , Lu Hongyu , Yu Chen , Wayne Xin Zhao , Ji-Rong Wen

Transformer-based sequential recommenders, such as SASRec or BERT4Rec, typically rely solely on learned item ID embeddings, making them vulnerable to the item cold-start problem, particularly in environments with dynamic item catalogs.…

Information Retrieval · Computer Science 2025-08-27 Jan Malte Lichtenberg , Antonio De Candia , Matteo Ruffini

Huge embedding tables in modern deep learning recommender models (DLRM) require prohibitively large memory during training and inference. This paper proposes FIITED, a system to automatically reduce the memory footprint via FIne-grained…

Information Retrieval · Computer Science 2024-10-15 Qinyi Luo , Penghan Wang , Wei Zhang , Fan Lai , Jiachen Mao , Xiaohan Wei , Jun Song , Wei-Yu Tsai , Shuai Yang , Yuxi Hu , Xuehai Qian

Deep learning-based models are utilized to achieve state-of-the-art performance for recommendation systems. A key challenge for these models is to work with millions of categorical classes or tokens. The standard approach is to learn…

Information Retrieval · Computer Science 2021-03-11 Aditya Desai , Yanzhou Pan , Kuangyuan Sun , Li Chou , Anshumali Shrivastava

Sequential Recommendation (SeqRec) aims to predict the next item by capturing sequential patterns from users' historical interactions, playing a crucial role in many real-world recommender systems. However, existing approaches predominantly…

Information Retrieval · Computer Science 2025-08-04 Jiakai Tang , Sunhao Dai , Teng Shi , Jun Xu , Xu Chen , Wen Chen , Jian Wu , Yuning Jiang

Deep learning recommendation models (DLRM) rely on large embedding tables to manage categorical sparse features. Expanding such embedding tables can significantly enhance model performance, but at the cost of increased GPU/CPU/memory usage.…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-07-01 Qinlong Wang , Tingfeng Lan , Yinghao Tang , Ziling Huang , Yiheng Du , Haitao Zhang , Jian Sha , Hui Lu , Yuanchun Zhou , Ke Zhang , Mingjie Tang

Agentic systems powered by Large Language Models (LLMs) have shown strong potential in recommender systems but remain hindered by several challenges. Fine-tuning LLMs is parameter-inefficient, and prompt-based agentic reasoning is limited…

Information Retrieval · Computer Science 2026-02-10 Minh-Duc Nguyen , Hai-Dang Kieu , Dung D. Le

Multimodal recommendation aims to recommend user-preferred candidates based on her/his historically interacted items and associated multimodal information. Previous studies commonly employ an embed-and-retrieve paradigm: learning user and…

Information Retrieval · Computer Science 2026-01-15 Han Liu , Yinwei Wei , Xuemeng Song , Weili Guan , Yuan-Fang Li , Liqiang Nie

Recently, the generality of natural language text has been leveraged to develop transferable recommender systems. The basic idea is to employ pre-trained language models~(PLM) to encode item text into item representations. Despite the…

Information Retrieval · Computer Science 2023-02-14 Yupeng Hou , Zhankui He , Julian McAuley , Wayne Xin Zhao

Recommendation models are very large, requiring terabytes (TB) of memory during training. In pursuit of better quality, the model size and complexity grow over time, which requires additional training data to avoid overfitting. This model…

Recommender systems have become an essential component of many online platforms, providing personalized recommendations to users. A crucial aspect is embedding techniques that convert the high-dimensional discrete features, such as user and…

Information Retrieval · Computer Science 2025-10-23 Maolin Wang , Xinjian Zhao , Wanyu Wang , Sheng Zhang , Jiansheng Li , Bowen Yu , Binhao Wang , Shucheng Zhou , Dawei Yin , Qing Li , Ruocheng Guo , Xiangyu Zhao

Nowadays, deep learning models are widely adopted in web-scale applications such as recommender systems, and online advertising. In these applications, embedding learning of categorical features is crucial to the success of deep learning…

Information Retrieval · Computer Science 2021-09-07 Bencheng Yan , Pengjie Wang , Jinquan Liu , Wei Lin , Kuang-Chih Lee , Jian Xu , Bo Zheng

Sequential recommender systems (SRS) have become the key technology in capturing user's dynamic interests and generating high-quality recommendations. Current state-of-the-art sequential recommender models are typically based on a…

Information Retrieval · Computer Science 2020-05-27 Yang Sun , Fajie Yuan , Min Yang , Guoao Wei , Zhou Zhao , Duo Liu