English
Related papers

Related papers: Learnable Embedding Sizes for Recommender Systems

200 papers

Deep learning recommendation systems serve personalized content under diverse tail-latency targets and input-query loads. In order to do so, state-of-the-art recommendation models rely on terabyte-scale embedding tables to learn user…

Hardware Architecture · Computer Science 2023-02-22 Samuel Hsia , Udit Gupta , Bilge Acun , Newsha Ardalani , Pan Zhong , Gu-Yeon Wei , David Brooks , Carole-Jean Wu

Deep learning recommendation systems at scale have provided remarkable gains through increasing model capacity (i.e. wider and deeper neural networks), but it comes at significant training cost and infrastructure cost. Model pruning is an…

Information Retrieval · Computer Science 2021-05-05 Xiaocong Du , Bhargav Bhushanam , Jiecao Yu , Dhruv Choudhary , Tianxiang Gao , Sherman Wong , Louis Feng , Jongsoo Park , Yu Cao , Arun Kejariwal

Recommender models are commonly used to suggest relevant items to a user for e-commerce and online advertisement-based applications. These models use massive embedding tables to store numerical representation of items' and users'…

Information Retrieval · Computer Science 2024-03-19 Muhammad Adnan , Yassaman Ebrahimzadeh Maboud , Divya Mahajan , Prashant J. Nair

Embedding of large but redundant data, such as images or text, in a hierarchy of lower-dimensional spaces is one of the key features of representation learning approaches, which nowadays provide state-of-the-art solutions to problems once…

Computer Vision and Pattern Recognition · Computer Science 2022-06-13 Gianluca Berardi , Luca De Luigi , Samuele Salti , Luigi Di Stefano

At the heart of contemporary recommender systems (RSs) are latent factor models that provide quality recommendation experience to users. These models use embedding vectors, which are typically of a uniform and fixed size, to represent users…

Information Retrieval · Computer Science 2026-02-05 Yunke Qu , Tong Chen , Quoc Viet Hung Nguyen , Hongzhi Yin

Recommender systems often rely on large embedding tables that map users and items to dense vectors of uniform size, leading to substantial memory consumption and inefficiencies. This is particularly problematic in memory-constrained…

Information Retrieval · Computer Science 2024-11-20 Yunke Qu , Liang Qu , Tong Chen , Xiangyu Zhao , Jianxin Li , Hongzhi Yin

With the rise of cloud-edge collaboration, recommendation services are increasingly trained in distributed environments. Federated Recommendation (FR) enables such multi-end collaborative training while preserving privacy by sharing model…

Machine Learning · Computer Science 2025-12-17 Haochen Yuan , Yang Zhang , Xiang He , Quan Z. Sheng , Zhongjie Wang

Embedding tables dominate industrial-scale recommendation model sizes, using up to terabytes of memory. A popular and the largest publicly available machine learning MLPerf benchmark on recommendation data is a Deep Learning Recommendation…

Machine Learning · Computer Science 2022-07-25 Aditya Desai , Anshumali Shrivastava

Accurate click-through rate (CTR) prediction is vital for online advertising and recommendation systems. Recent deep learning advancements have improved the ability to capture feature interactions and understand user interests. However,…

Information Retrieval · Computer Science 2025-02-24 Kefan Wang , Hao Wang , Kenan Song , Wei Guo , Kai Cheng , Zhi Li , Yong Liu , Defu Lian , Enhong Chen

With the continuous increase of users and items, conventional recommender systems trained on static datasets can hardly adapt to changing environments. The high-throughput data requires the model to be updated in a timely manner for…

Information Retrieval · Computer Science 2023-08-16 Bowei He , Xu He , Renrui Zhang , Yingxue Zhang , Ruiming Tang , Chen Ma

Learning high-quality feature embeddings efficiently and effectively is critical for the performance of web-scale machine learning systems. A typical model ingests hundreds of features with vocabularies on the order of millions to billions…

Machine Learning · Computer Science 2024-06-19 Benjamin Coleman , Wang-Cheng Kang , Matthew Fahrbach , Ruoxi Wang , Lichan Hong , Ed H. Chi , Derek Zhiyuan Cheng

The rapid advancement of large language models (LLMs) has led to architectures with billions to trillions of parameters, posing significant deployment challenges due to their substantial demands on memory, processing power, and energy…

Machine Learning · Computer Science 2024-07-02 Enshu Liu , Junyi Zhu , Zinan Lin , Xuefei Ning , Matthew B. Blaschko , Shengen Yan , Guohao Dai , Huazhong Yang , Yu Wang

Recommendation algorithms that incorporate techniques from deep learning are becoming increasingly popular. Due to the structure of the data coming from recommendation domains (i.e., one-hot-encoded vectors of item preferences), these…

Machine Learning · Computer Science 2017-06-14 Joan Serrà , Alexandros Karatzoglou

In deep learning, embeddings are widely used to represent categorical entities such as words, apps, and movies. An embedding layer maps each entity to a unique vector, causing the layer's memory requirement to be proportional to the number…

Machine Learning · Computer Science 2022-03-22 Niketan Pansare , Jay Katukuri , Aditya Arora , Frank Cipollone , Riyaaz Shaik , Noyan Tokgozoglu , Chandru Venkataraman

Deep learning-based recommendation systems (e.g., DLRMs) are widely used AI models to provide high-quality personalized recommendations. Training data used for modern recommendation systems commonly includes categorical features taking on…

Information Retrieval · Computer Science 2026-01-06 Gopi Krishna Jha , Anthony Thomas , Nilesh Jain , Sameh Gobriel , Tajana Rosing , Ravi Iyer

Since the creation of the Web, recommender systems (RSs) have been an indispensable mechanism in information filtering. State-of-the-art RSs primarily depend on categorical features, which ecoded by embedding vectors, resulting in…

Information Retrieval · Computer Science 2025-01-22 Hung Vinh Tran , Tong Chen , Quoc Viet Hung Nguyen , Zi Huang , Lizhen Cui , Hongzhi Yin

Behavioral patterns captured in embeddings learned from interaction data are pivotal across various stages of production recommender systems. However, in the initial retrieval stage, practitioners face an inherent tradeoff between embedding…

Information Retrieval · Computer Science 2026-02-11 Vojtěch Vančura , Martin Spišák , Rodrigo Alves , Ladislav Peška

As a crucial component of most modern deep recommender systems, feature embedding maps high-dimensional sparse user/item features into low-dimensional dense embeddings. However, these embeddings are usually assigned a unified dimension,…

Information Retrieval · Computer Science 2022-04-18 Liang Qu , Yonghong Ye , Ningzhi Tang , Lixin Zhang , Yuhui Shi , Hongzhi Yin

Retrieval augmentation has become an effective solution to empower large language models (LLMs) with external and verified knowledge sources from the database, which overcomes the limitations and hallucinations of LLMs in handling…

Information Retrieval · Computer Science 2023-11-21 Tong Wu , Yulei Qin , Enwei Zhang , Zihan Xu , Yuting Gao , Ke Li , Xing Sun

Recommender systems have become an essential component of many online platforms, providing personalized recommendations to users. A crucial aspect is embedding techniques that convert the high-dimensional discrete features, such as user and…

Information Retrieval · Computer Science 2025-10-23 Maolin Wang , Xinjian Zhao , Wanyu Wang , Sheng Zhang , Jiansheng Li , Bowen Yu , Binhao Wang , Shucheng Zhou , Dawei Yin , Qing Li , Ruocheng Guo , Xiangyu Zhao