English
Related papers

Related papers: On the Embedding Collapse when Scaling up Recommen…

200 papers

Recommender systems learn from historical user-item interactions to identify preferred items for target users. These observed interactions are usually unbalanced following a long-tailed distribution. Such long-tailed data lead to popularity…

Information Retrieval · Computer Science 2022-11-03 Weijieying Ren , Lei Wang , Kunpeng Liu , Ruocheng Guo , Lim Ee Peng , Yanjie Fu

Industry-scale recommendation systems have become a cornerstone of the e-commerce shopping experience. For Etsy, an online marketplace with over 50 million handmade and vintage items, users come to rely on personalized recommendations to…

Information Retrieval · Computer Science 2018-12-12 Xiaoting Zhao , Raphael Louca , Diane Hu , Liangjie Hong

Multimodal recommendation has emerged as a mainstream paradigm, typically leveraging text and visual embeddings extracted from pre-trained models such as Sentence-BERT, Vision Transformers, and ResNet. This approach is founded on the…

Information Retrieval · Computer Science 2026-01-19 Yu Ye , Junchen Fu , Yu Song , Kaiwen Zheng , Joemon M. Jose

Self-supervised representation learning is central to modern machine learning because it extracts structured latent features from unlabeled data and enables robust transfer across tasks and domains. However, it can suffer from…

Disordered Systems and Neural Networks · Physics 2026-04-14 Louie Hong Yao , Yuhao Li , Shengchao Liu

Modern recommendation systems rely on real-valued embeddings of categorical features. Increasing the dimension of embedding vectors improves model accuracy but comes at a high cost to model size. We introduce a multi-layer embedding…

Machine Learning · Computer Science 2020-06-11 Benjamin Ghaemmaghami , Zihao Deng , Benjamin Cho , Leo Orshansky , Ashish Kumar Singh , Mattan Erez , Michael Orshansky

As the core of recommender system, collaborative filtering (CF) models the affinity between a user and an item from historical user-item interactions, such as clicks, purchases, and so on. Benefited from the strong representation power,…

Information Retrieval · Computer Science 2019-06-27 Xiaoyu Du , Xiangnan He , Fajie Yuan , Jinhui Tang , Zhiguang Qin , Tat-Seng Chua

Recently, embedding techniques have achieved impressive success in recommender systems. However, the embedding techniques are data demanding and suffer from the cold-start problem. Especially, for the cold-start item which only has limited…

Information Retrieval · Computer Science 2021-05-12 Yongchun Zhu , Ruobing Xie , Fuzhen Zhuang , Kaikai Ge , Ying Sun , Xu Zhang , Leyu Lin , Juan Cao

Over the past 10 years, many recommendation techniques have been based on embedding users and items in latent vector spaces, where the inner product of a (user,item) pair of vectors represents the predicted affinity of the user to the item.…

Information Retrieval · Computer Science 2019-07-09 Sonya Liberman , Shaked Bar , Raphael Vannerom , Danny Rosenstein , Ronny Lempel

We present Tencent's ads recommendation system and examine the challenges and practices of learning appropriate recommendation representations. Our study begins by showcasing our approaches to preserving prior knowledge when encoding…

Information Retrieval · Computer Science 2024-07-09 Junwei Pan , Wei Xue , Ximei Wang , Haibin Yu , Xun Liu , Shijie Quan , Xueming Qiu , Dapeng Liu , Lei Xiao , Jie Jiang

Personalized size and fit recommendations bear crucial significance for any fashion e-commerce platform. Predicting the correct fit drives customer satisfaction and benefits the business by reducing costs incurred due to size-related…

Learning high-quality feature embeddings efficiently and effectively is critical for the performance of web-scale machine learning systems. A typical model ingests hundreds of features with vocabularies on the order of millions to billions…

Machine Learning · Computer Science 2024-06-19 Benjamin Coleman , Wang-Cheng Kang , Matthew Fahrbach , Ruoxi Wang , Lichan Hong , Ed H. Chi , Derek Zhiyuan Cheng

To alleviate the problem of information explosion, recommender systems are widely deployed to provide personalized information filtering services. Usually, embedding tables are employed in recommender systems to transform high-dimensional…

Information Retrieval · Computer Science 2024-08-07 Shiwei Li , Huifeng Guo , Xing Tang , Ruiming Tang , Lu Hou , Ruixuan Li , Rui Zhang

In self-supervised representation learning, a common idea behind most of the state-of-the-art approaches is to enforce the robustness of the representations to predefined augmentations. A potential issue of this idea is the existence of…

Machine Learning · Computer Science 2021-08-26 Tianyu Hua , Wenxiao Wang , Zihui Xue , Sucheng Ren , Yue Wang , Hang Zhao

The rapid evolution of technology has transformed business operations and customer interactions worldwide, with personalization emerging as a key opportunity for e-commerce companies to engage customers more effectively. The application of…

Machine Learning · Computer Science 2024-08-27 Miguel Alves Gomes , Philipp Meisen , Tobias Meisen

In recent years, recommender systems have advanced rapidly, where embedding learning for users and items plays a critical role. A standard method learns a unique embedding vector for each user and item. However, such a method has two…

Artificial Intelligence · Computer Science 2023-02-13 Yizhou Chen , Guangda Huzhang , Anxiang Zeng , Qingtao Yu , Hui Sun , Heng-yi Li , Jingyi Li , Yabo Ni , Han Yu , Zhiming Zhou

As a pivotal tool to alleviate the information overload problem, recommender systems aim to predict user's preferred items from millions of candidates by analyzing observed user-item relations. As for alleviating the sparsity and cold start…

Information Retrieval · Computer Science 2022-05-24 Yue Deng

Multi-label classification (MLC) studies the problem where each instance is associated with multiple relevant labels, which leads to the exponential growth of output space. MLC encourages a popular framework named label compression (LC) for…

Machine Learning · Computer Science 2020-09-21 Jiaqi Lv , Tianran Wu , Chenglun Peng , Yunpeng Liu , Ning Xu , Xin Geng

We tackle the challenge of feature embedding for the purposes of improving the click-through rate prediction process. We select three models: logistic regression, factorization machines and deep factorization machines, as our baselines and…

Machine Learning · Computer Science 2022-09-21 Samo Pahor , Davorin Kopič , Jure Demšar

Training deep neural networks for classification often includes minimizing the training loss beyond the zero training error point. In this phase of training, a "neural collapse" behavior has been observed: the variability of features…

Machine Learning · Computer Science 2023-05-30 Tom Tirer , Haoxiang Huang , Jonathan Niles-Weed

Multimodal recommendation aims to model user and item representations comprehensively with the involvement of multimedia content for effective recommendations. Existing research has shown that it is beneficial for recommendation performance…

Information Retrieval · Computer Science 2024-05-24 Yuting Liu , Enneng Yang , Yizhou Dang , Guibing Guo , Qiang Liu , Yuliang Liang , Linying Jiang , Xingwei Wang