English
Related papers

Related papers: The Evolution of Embedding Table Optimization and …

200 papers

Embedding techniques have become essential components of large databases in the deep learning era. By encoding discrete entities, such as words, items, or graph nodes, into continuous vector spaces, embeddings facilitate more efficient…

Information Retrieval · Computer Science 2024-10-18 Shiwei Li , Zhuoqi Hu , Xing Tang , Haozhao Wang , Shijie Xu , Weihong Luo , Yuhua Li , Xiuqiang He , Ruixuan Li

Click-through rate (CTR) prediction has been one of the most central problems in computational advertising. Lately, embedding techniques that produce low-dimensional representations of ad IDs drastically improve CTR prediction accuracies.…

Machine Learning · Computer Science 2019-04-29 Feiyang Pan , Shuokai Li , Xiang Ao , Pingzhong Tang , Qing He

To alleviate the problem of information explosion, recommender systems are widely deployed to provide personalized information filtering services. Usually, embedding tables are employed in recommender systems to transform high-dimensional…

Information Retrieval · Computer Science 2024-08-07 Shiwei Li , Huifeng Guo , Xing Tang , Ruiming Tang , Lu Hou , Ruixuan Li , Rui Zhang

Performance optimization is an increasingly challenging but often repetitive task. While each platform has its quirks, the underlying code transformations rely on data movement and computational characteristics that recur across…

Software Engineering · Computer Science 2023-03-16 Lukas Trümper , Tal Ben-Nun , Philipp Schaad , Alexandru Calotoiu , Torsten Hoefler

Dense embedding models are commonly deployed in commercial search engines, wherein all the document vectors are pre-computed, and near-neighbor search (NNS) is performed with the query vector to find relevant documents. However, the…

Machine Learning · Computer Science 2020-09-01 Tharun Medini , Beidi Chen , Anshumali Shrivastava

The embedding-based representation learning is commonly used in deep learning recommendation models to map the raw sparse features to dense vectors. The traditional embedding manner that assigns a uniform size to all features has two…

Machine Learning · Computer Science 2021-03-12 Siyi Liu , Chen Gao , Yihong Chen , Depeng Jin , Yong Li

Deep neural networks have become the method of choice for solving many classification tasks, largely because they can fit very complex functions defined over raw data. The downside of such powerful learners is the danger of overfit. In this…

Machine Learning · Computer Science 2023-12-29 Uri Stern , Daniel Shwartz , Daphna Weinshall

The lightweight ad ranking layer, living after the retrieval stage and before the fine ranker, plays a critical role in the success of a cascaded ad recommendation system. Due to the fact that there are multiple optimization tasks depending…

Information Retrieval · Computer Science 2025-10-14 Xiao Yang , Peifeng Yin , Abe Engle , Jinfeng Zhuang , Ling Leng

Graph Convolutional Networks (GCN) can efficiently integrate graph structure and node features to learn high-quality node embeddings. These embeddings can then be used for several tasks such as recommendation and search. At Pinterest, we…

Deep learning techniques have been applied widely in industrial recommendation systems. However, far less attention has been paid to the overfitting problem of models in recommendation systems, which, on the contrary, is recognized as a…

Information Retrieval · Computer Science 2022-09-14 Zhao-Yu Zhang , Xiang-Rong Sheng , Yujing Zhang , Biye Jiang , Shuguang Han , Hongbo Deng , Bo Zheng

Collaborative Filtering (CF) has emerged as one of the most prominent implementation strategies for building recommender systems. The key idea is to exploit the usage patterns of individuals to generate personalized recommendations. CF…

Information Retrieval · Computer Science 2025-02-18 Adamya Shyam , Ramya Kamani , Venkateswara Rao Kagita , Vikas Kumar

Deep learning has revolutionized many industries by enabling models to automatically learn complex patterns from raw data, reducing dependence on manual feature engineering. However, deep learning algorithms are sensitive to input data, and…

Machine Learning · Computer Science 2025-07-21 Mert Sehri , Zehui Hua , Francisco de Assis Boldt , Patrick Dumond

Learning high-quality feature embeddings efficiently and effectively is critical for the performance of web-scale machine learning systems. A typical model ingests hundreds of features with vocabularies on the order of millions to billions…

Machine Learning · Computer Science 2024-06-19 Benjamin Coleman , Wang-Cheng Kang , Matthew Fahrbach , Ruoxi Wang , Lichan Hong , Ed H. Chi , Derek Zhiyuan Cheng

Graph Neural Networks (GNN) have been extensively applied to industry recommendation systems, as seen in models like GraphSage\cite{GraphSage}, TwHIM\cite{TwHIM}, LiGNN\cite{LiGNN} etc. In these works, graphs were constructed based on…

Multi-label learning is concerned with the classification of data with multiple class labels. This is in contrast to the traditional classification problem where every data instance has a single label. Due to the exponential size of output…

Machine Learning · Computer Science 2018-12-27 Vikas Kumar , Arun K Pujari , Vineet Padmanabhan , Venkateswara Rao Kagita

Data-driven approaches such as deep learning can result in predictive models for material properties with exceptional accuracy and efficiency. However, in many applications, data is sparse, severely limiting their accuracy and…

Machine Learning · Computer Science 2025-10-29 Robert J Appleton , Brian C Barnes , Alejandro Strachan

The rapid evolution of technology has transformed business operations and customer interactions worldwide, with personalization emerging as a key opportunity for e-commerce companies to engage customers more effectively. The application of…

Machine Learning · Computer Science 2024-08-27 Miguel Alves Gomes , Philipp Meisen , Tobias Meisen

Showing items that do not match search query intent degrades customer experience in e-commerce. These mismatches result from counterfactual biases of the ranking algorithms toward noisy behavioral signals such as clicks and purchases in the…

Computation and Language · Computer Science 2020-05-08 Thanh V. Nguyen , Nikhil Rao , Karthik Subbian

In this paper, we present OmniSearchSage, a versatile and scalable system for understanding search queries, pins, and products for Pinterest search. We jointly learn a unified query embedding coupled with pin and product embeddings, leading…

Information Retrieval · Computer Science 2024-04-26 Prabhat Agarwal , Minhazul Islam Sk , Nikil Pancha , Kurchi Subhra Hazra , Jiajing Xu , Chuck Rosenberg

Embedding tables are usually huge in click-through rate (CTR) prediction models. To train and deploy the CTR models efficiently and economically, it is necessary to compress their embedding tables at the training stage. To this end, we…

Machine Learning · Computer Science 2024-08-07 Shiwei Li , Huifeng Guo , Lu Hou , Wei Zhang , Xing Tang , Ruiming Tang , Rui Zhang , Ruixuan Li