English
Related papers

Related papers: Memory-efficient Embedding for Recommendations

200 papers

To alleviate the problem of information explosion, recommender systems are widely deployed to provide personalized information filtering services. Usually, embedding tables are employed in recommender systems to transform high-dimensional…

Information Retrieval · Computer Science 2024-08-07 Shiwei Li , Huifeng Guo , Xing Tang , Ruiming Tang , Lu Hou , Ruixuan Li , Rui Zhang

Multimodal Recommender Systems aim to improve recommendation accuracy by integrating heterogeneous content, such as images and textual metadata. While effective, it remains unclear whether their gains stem from true multimodal understanding…

Information Retrieval · Computer Science 2025-08-07 Claudio Pomo , Matteo Attimonelli , Danilo Danese , Fedelucio Narducci , Tommaso Di Noia

In recent years, neural networks and other complex models have dominated recommender systems, often setting new benchmarks for state-of-the-art performance. Yet, despite these advancements, award-winning research has demonstrated that…

Information Retrieval · Computer Science 2026-04-20 Pedro R. Pires , Rafael T. Sereicikas , Gregorio F. Azevedo , Tiago A. Almeida

Recommender systems typically represent users and items by learning their embeddings, which are usually set to uniform dimensions and dominate the model parameters. However, real-world recommender systems often operate in streaming…

Information Retrieval · Computer Science 2026-02-05 Yunke Qu , Liang Qu , Tong Chen , Xiangyu Zhao , Quoc Viet Hung Nguyen , Hongzhi Yin

The performance bottleneck of deep-learning-based recommender systems resides in their backbone Deep Neural Networks. By integrating Processing-In-Memory~(PIM) architectures, researchers can reduce data movement and enhance energy…

Hardware Architecture · Computer Science 2025-05-19 Feng Cheng , Tunhou Zhang , Junyao Zhang , Jonathan Hao-Cheng Ku , Yitu Wang , Xiaoxuan Yang , Hai , Li , Yiran Chen

In the domain of streaming recommender systems, conventional methods for addressing new user IDs or item IDs typically involve assigning initial ID embeddings randomly. However, this practice results in two practical challenges: (i) Items…

Information Retrieval · Computer Science 2023-08-15 Ziru Liu , Kecheng Chen , Fengyi Song , Bo Chen , Xiangyu Zhao , Huifeng Guo , Ruiming Tang

Assembly-based tools provide a powerful modeling paradigm for non-expert shape designers. However, choosing a component from a large shape repository and aligning it to a partial assembly can become a daunting task. In this paper we…

Graphics · Computer Science 2018-07-05 Minhyuk Sung , Hao Su , Vladimir G. Kim , Siddhartha Chaudhuri , Leonidas Guibas

Deep Learning Recommendation Models (DLRMs) have gained popularity in recommendation systems due to their effectiveness in handling large-scale recommendation tasks. The embedding layers of DLRMs have become the performance bottleneck due…

Information Retrieval · Computer Science 2024-10-10 Sitian Chen , Haobin Tan , Amelie Chi Zhou , Yusen Li , Pavan Balaji

Federated cross-domain recommendation (Federated CDR) aims to collaboratively learn personalized recommendation models across heterogeneous domains while preserving data privacy. Recently, large language model (LLM)-based recommendation…

Information Retrieval · Computer Science 2026-02-19 Xinrui He , Ting-Wei Li , Tianxin Wei , Xuying Ning , Xinyu He , Wenxuan Bao , Hanghang Tong , Jingrui He

Feature embedding learning and feature interaction modeling are two crucial components of deep models for Click-Through Rate (CTR) prediction. Most existing deep CTR models suffer from the following three problems. First, feature…

Information Retrieval · Computer Science 2021-12-14 Chenxu Zhu , Bo Chen , Weinan Zhang , Jincai Lai , Ruiming Tang , Xiuqiang He , Zhenguo Li , Yong Yu

Multimodal recommendation aims to model user and item representations comprehensively with the involvement of multimedia content for effective recommendations. Existing research has shown that it is beneficial for recommendation performance…

Information Retrieval · Computer Science 2024-05-24 Yuting Liu , Enneng Yang , Yizhou Dang , Guibing Guo , Qiang Liu , Yuliang Liang , Linying Jiang , Xingwei Wang

Designing an effective loss function plays a crucial role in training deep recommender systems. Most existing works often leverage a predefined and fixed loss function that could lead to suboptimal recommendation quality and training…

Information Retrieval · Computer Science 2021-06-15 Xiangyu Zhao , Haochen Liu , Wenqi Fan , Hui Liu , Jiliang Tang , Chong Wang

Feature embeddings are one of the most essential steps when training deep learning based Click-Through Rate prediction models, which map high-dimensional sparse features to dense embedding vectors. Classic human-crafted embedding size…

Information Retrieval · Computer Science 2022-08-18 Tesi Xiao , Xia Xiao , Ming Chen , Youlong Chen

Recommendation problems with large numbers of discrete items, such as products, webpages, or videos, are ubiquitous in the technology industry. Deep neural networks are being increasingly used for these recommendation problems. These models…

Machine Learning · Computer Science 2019-07-11 Manas R. Joglekar , Cong Li , Jay K. Adams , Pranav Khaitan , Quoc V. Le

Recommendation algorithms that incorporate techniques from deep learning are becoming increasingly popular. Due to the structure of the data coming from recommendation domains (i.e., one-hot-encoded vectors of item preferences), these…

Machine Learning · Computer Science 2017-06-14 Joan Serrà , Alexandros Karatzoglou

The representational capacity of modern neural network architectures has made them a default choice in various applications with high dimensional feature sets. But these high dimensional and potentially noisy features combined with the…

Machine Learning · Computer Science 2020-10-13 Vinay Varma K

Learning high-quality feature embeddings efficiently and effectively is critical for the performance of web-scale machine learning systems. A typical model ingests hundreds of features with vocabularies on the order of millions to billions…

Machine Learning · Computer Science 2024-06-19 Benjamin Coleman , Wang-Cheng Kang , Matthew Fahrbach , Ruoxi Wang , Lichan Hong , Ed H. Chi , Derek Zhiyuan Cheng

Modern recommendation systems rely on real-valued embeddings of categorical features. Increasing the dimension of embedding vectors improves model accuracy but comes at a high cost to model size. We introduce a multi-layer embedding…

Machine Learning · Computer Science 2020-06-11 Benjamin Ghaemmaghami , Zihao Deng , Benjamin Cho , Leo Orshansky , Ashish Kumar Singh , Mattan Erez , Michael Orshansky

Although deep learning-based personalized recommendation systems provide qualified recommendations, they strain data center resources. The main bottleneck is the embedding layer, which is highly memory-intensive due to its sparse, irregular…

Hardware Architecture · Computer Science 2025-11-26 Youngsuk Kim , Junghwan Lim , Hyuk-Jae Lee , Chae Eun Rhee

Large-scale industrial recommender systems are usually confronted with computational problems due to the enormous corpus size. To retrieve and recommend the most relevant items to users under response time limits, resorting to an efficient…

Information Retrieval · Computer Science 2019-11-21 Han Zhu , Daqing Chang , Ziru Xu , Pengye Zhang , Xiang Li , Jie He , Han Li , Jian Xu , Kun Gai