English
Related papers

Related papers: Communication-Efficient TeraByte-Scale Model Train…

200 papers

A large-scale industrial recommendation platform typically consists of multiple associated scenarios, requiring a unified click-through rate (CTR) prediction model to serve them simultaneously. Existing approaches for multi-scenario CTR…

Information Retrieval · Computer Science 2023-06-26 Xing Tang , Yang Qiao , Yuwen Fu , Fuyuan Lyu , Dugang Liu , Xiuqiang He

Training Graph Neural Networks (GNNs) on large graphs presents unique challenges due to the large memory and computing requirements. Distributed GNN training, where the graph is partitioned across multiple machines, is a common approach to…

Machine Learning · Computer Science 2024-06-26 Juan Cervino , Md Asadullah Turja , Hesham Mostafa , Nageen Himayat , Alejandro Ribeiro

Large recommendation models (LRMs) are fundamental to the multi-billion dollar online advertising industry, processing massive datasets of hundreds of billions of examples before transitioning to continuous online training to adapt to…

Information Retrieval · Computer Science 2024-10-28 Kshitij Jain , Jingru Xie , Kevin Regan , Cheng Chen , Jie Han , Steve Li , Zhuoshu Li , Todd Phillips , Myles Sussman , Matt Troup , Angel Yu , Jia Zhuo

Scalable training of large models (like BERT and GPT-3) requires careful optimization rooted in model design, architecture, and system capabilities. From a system standpoint, communication has become a major bottleneck, especially on…

Machine Learning · Computer Science 2021-07-01 Hanlin Tang , Shaoduo Gan , Ammar Ahmad Awan , Samyam Rajbhandari , Conglong Li , Xiangru Lian , Ji Liu , Ce Zhang , Yuxiong He

In online advertising scenario, sellers often create multiple creatives to provide comprehensive demonstrations, making it essential to present the most appealing design to maximize the Click-Through Rate (CTR). However, sellers generally…

Information Retrieval · Computer Science 2024-01-23 Hao Yang , Jianxin Yuan , Shuai Yang , Linhe Xu , Shuo Yuan , Yifan Zeng

Large embedding tables are indispensable in modern recommendation systems, thanks to their ability to effectively capture and memorize intricate details of interactions among diverse entities. As we explore integrating large embedding…

Recently, a new paradigm, meta learning, has been widely applied to Deep Learning Recommendation Models (DLRM) and significantly improves statistical performance, especially in cold-start scenarios. However, the existing systems are not…

Machine Learning · Computer Science 2024-04-16 Youshao Xiao , Shangchun Zhao , Zhenglei Zhou , Zhaoxin Huan , Lin Ju , Xiaolu Zhang , Lin Wang , Jun Zhou

Conversational Recommender Systems (CRSs) in E-commerce platforms aim to recommend items to users via multiple conversational interactions. Click-through rate (CTR) prediction models are commonly used for ranking candidate items. However,…

Information Retrieval · Computer Science 2021-05-03 Chi-Man Wong , Fan Feng , Wen Zhang , Chi-Man Vong , Hui Chen , Yichi Zhang , Peng He , Huan Chen , Kun Zhao , Huajun Chen

In this talk, we introduce Merlin HugeCTR. Merlin HugeCTR is an open source, GPU-accelerated integration framework for click-through rate estimation. It optimizes both training and inference, whilst enabling model training at scale with…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-10-18 Joey Wang , Yingcan Wei , Minseok Lee , Matthias Langer , Fan Yu , Jie Liu , Alex Liu , Daniel Abel , Gems Guo , Jianbing Dong , Jerry Shi , Kunlun Li

Click-through rate (CTR) prediction is one of the most central tasks in online advertising systems. Recent deep learning-based models that exploit feature embedding and high-order data nonlinearity have shown dramatic successes in CTR…

Information Retrieval · Computer Science 2021-05-20 Wentao Ouyang , Xiuwu Zhang , Shukui Ren , Li Li , Kun Zhang , Jinmei Luo , Zhaojie Liu , Yanlong Du

Advertising text plays a critical role in determining click-through rates (CTR) in online advertising. Large Language Models (LLMs) offer significant efficiency advantages over manual ad text creation. However, LLM-generated ad texts do not…

Information Retrieval · Computer Science 2025-08-05 Yanda Chen , Zihui Ren , Qixiang Gao , Jiale Chen , Si Chen , Xubin Li , Tiezheng Ge , Bo Zheng

Click-through rate (CTR) prediction is a critical task for many industrial systems, such as display advertising and recommender systems. Recently, modeling user behavior sequences attracts much attention and shows great improvements in the…

Information Retrieval · Computer Science 2020-08-27 Yufei Feng , Fuyu Lv , Binbin Hu , Fei Sun , Kun Kuang , Yang Liu , Qingwen Liu , Wenwu Ou

Distributed deep learning (DL) has become prevalent in recent years to reduce training time by leveraging multiple computing devices (e.g., GPUs/TPUs) due to larger models and datasets. However, system scalability is limited by…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-09-04 Zhenheng Tang , Shaohuai Shi , Wei Wang , Bo Li , Xiaowen Chu

Click-Through Rate prediction (CTR) is a crucial task in recommender systems, and it gained considerable attention in the past few years. The primary purpose of recent research emphasizes obtaining meaningful and powerful representations…

Information Retrieval · Computer Science 2022-10-26 Shereen Elsayed , Lars Schmidt-Thieme

Learning embedding table plays a fundamental role in Click-through rate(CTR) prediction from the view of the model performance and memory usage. The embedding table is a two-dimensional tensor, with its axes indicating the number of feature…

Information Retrieval · Computer Science 2022-09-07 Fuyuan Lyu , Xing Tang , Hong Zhu , Huifeng Guo , Yingxue Zhang , Ruiming Tang , Xue Liu

Graph Convolutional Networks (GCNs), particularly for large-scale graphs, are crucial across numerous domains. However, training distributed full-batch GCNs on large-scale graphs suffers from inefficient memory access patterns and high…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-05-27 Chen Zhuang , Lingqi Zhang , Du Wu , Peng Chen , Jiajun Huang , Xin Liu , Rio Yokota , Nikoli Dryden , Toshio Endo , Satoshi Matsuoka , Mohamed Wahib

Understanding user interests is crucial for Click-Through Rate (CTR) prediction tasks. In sequential recommendation, pre-training from user historical behaviors through self-supervised learning can better comprehend user dynamic…

Information Retrieval · Computer Science 2024-07-30 Ruidong Han , Qianzhong Li , He Jiang , Rui Li , Yurou Zhao , Xiang Li , Wei Lin

The past few years have witnessed the flourishing of large-scale deep neural network models with ever-growing parameter numbers. Training such large-scale models typically requires massive memory and computing resources, necessitating…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-08-30 Yunze Wei , Tianshuo Hu , Cong Liang , Yong Cui

Predicting the probability that a user will click on a specific advertisement has been a prevalent issue in online advertising, attracting much research attention in the past decades. As a hot research frontier driven by industrial needs,…

Information Retrieval · Computer Science 2022-02-23 Yanwu Yang , Panyu Zhai

The Gradient Boosted Tree (GBT) algorithm is one of the most popular machine learning algorithms used in production, for tasks that include Click-Through Rate (CTR) prediction and learning-to-rank. To deal with the massive datasets…

Machine Learning · Computer Science 2019-05-30 Theodore Vasiloudis , Hyunsu Cho , Henrik Boström