English
Related papers

Related papers: MTGenRec: An Efficient Distributed Training System…

200 papers

Sequential recommender systems rank relevant items by modeling a user's interaction history and computing the inner product between the resulting user representation and stored item embeddings. To avoid the significant memory overhead of…

In recent years, owing to the outstanding performance in graph representation learning, graph neural network (GNN) techniques have gained considerable interests in many real-world scenarios, such as recommender systems and social networks.…

Machine Learning · Computer Science 2021-12-09 Weibin Li , Mingkai He , Zhengjie Huang , Xianming Wang , Shikun Feng , Weiyue Su , Yu Sun

Graph convolutional networks (GCNs) have been employed as a kind of significant tool on many graph-based applications recently. Inspired by convolutional neural networks (CNNs), GCNs generate the embeddings of nodes by aggregating the…

Machine Learning · Computer Science 2020-11-20 Tao Huang , Yihan Zhang , Jiajing Wu , Junyuan Fang , Zibin Zheng

Generative recommendation (GenRec) models typically model user behavior via full attention, but scaling to lifelong sequences is hindered by prohibitive computational costs and noise accumulation from stochastic interactions. To address…

Information Retrieval · Computer Science 2026-02-16 Yixiao Chen , Yuan Wang , Yue Liu , Qiyao Wang , Ke Cheng , Xin Xu , Juntong Yan , Shuojin Yang , Menghao Guo , Jun Zhang , Huan Yu , Jie Jiang

Recent advancements in generative recommendation systems, particularly in the realm of sequential recommendation tasks, have shown promise in enhancing generalization to new items. Among these approaches, diffusion-based generative…

Information Retrieval · Computer Science 2024-10-23 Guoqing Hu , Zhengyi Yang , Zhibo Cai , An Zhang , Xiang Wang

Deep learning models in recommender systems are usually trained in the batch mode, namely iteratively trained on a fixed-size window of training data. Such batch mode training of deep learning models suffers from low training efficiency,…

Information Retrieval · Computer Science 2020-09-07 Yichao Wang , Huifeng Guo , Ruiming Tang , Zhirong Liu , Xiuqiang He

Industrial-scale recommender systems rely on a cascade pipeline in which the retrieval stage must return a high-recall candidate set from billions of items under tight latency. Existing solutions either (i) suffer from limited…

Information Retrieval · Computer Science 2026-04-02 Yijia Sun , Shanshan Huang , Zhiyuan Guan , Qiang Luo , Ruiming Tang , Kun Gai , Guorui Zhou

Recommender systems are widely used in industry to improve user experience. Despite great success, they have recently been criticized for collecting private user data. Federated Learning (FL) is a new paradigm for learning on distributed…

Machine Learning · Computer Science 2022-10-26 Junyi Li , Heng Huang

Inference for Deep Neural Networks is increasingly being executed locally on mobile and embedded platforms due to its advantages in latency, privacy and connectivity. Since modern System on Chips typically execute a combination of different…

Computer Vision and Pattern Recognition · Computer Science 2021-05-11 Lei Xun , Long Tran-Thanh , Bashir M Al-Hashimi , Geoff V. Merrett

Generative recommendation models can model user behavior as sequences of events and provide a shared backbone for multiple recommendation tasks. In production, however, pre-training gains do not automatically translate into downstream…

Information Retrieval · Computer Science 2026-05-25 Qiuling Xu , Ko-Jen Hsiao , Moumita Bhattacharya

In this paper, we aim to maximize the SSR for heterogeneous service demands in the cooperative MEC-assisted RAN slicing system by jointly considering the multi-node computing resources cooperation and allocation, the transmission resource…

Networking and Internet Architecture · Computer Science 2024-05-29 Chong Zheng , Yongming Huang , Cheng Zhang , Tony Q. S. Quek

Collaborative filtering-based recommender systems that rely on a single type of behavior often encounter serious sparsity issues in real-world applications, leading to unsatisfactory performance. Multi-behavior Recommendation (MBR) is a…

Information Retrieval · Computer Science 2023-06-21 Mingshi Yan , Zhiyong Cheng , Jing Sun , Fuming Sun , Yuxin Peng

Large-scale Ads recommendation and auction scoring models at Google scale demand immense computational resources. While specialized hardware like TPUs have improved linear algebra computations, bottlenecks persist in large-scale systems.…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-01-22 George Kurian , Somayeh Sardashti , Ryan Sims , Felix Berger , Gary Holt , Yang Li , Jeremiah Willcock , Kaiyuan Wang , Herve Quiroz , Abdulrahman Salem , Julian Grady

Generative recommendation (GenRec) offers LLM integration, reduced embedding costs, and eliminates per-candidate scoring, attracting great attention. Despite its promising performance, this study reveals that it suffers from generation…

Information Retrieval · Computer Science 2025-07-08 Kun Yang , Siyao Zheng , Tianyi Li , Xiaodong Li , Hui Li

Recommender systems that can learn from cross-session data to dynamically predict the next item a user will choose are crucial for online platforms. However, existing approaches often use out-of-the-box sequence models which are limited by…

Social and Information Networks · Computer Science 2019-04-14 Jiaxuan You , Yichen Wang , Aditya Pal , Pong Eksombatchai , Chuck Rosenberg , Jure Leskovec

Deep learning recommendation models (DLRMs) are widely used in industry, and their memory capacity requirements reach the terabyte scale. Tiered memory architectures provide a cost-effective solution but introduce challenges in…

Performance · Computer Science 2025-11-12 Jie Ren , Bin Ma , Shuangyan Yang , Benjamin Francis , Ehsan K. Ardestani , Min Si , Dong Li

Generative retrieval methods utilize generative sequential modeling techniques, such as transformers, to generate candidate items for recommender systems. These methods have demonstrated promising results in academic benchmarks, surpassing…

Information Retrieval · Computer Science 2026-03-05 Prabhat Agarwal , Anirudhan Badrinath , Laksh Bhasin , Jaewon Yang , Edoardo Botta , Jiajing Xu , Charles Rosenberg

Sequential recommendation is a task to capture hidden user preferences from historical user item interaction data and recommend next items for the user. Significant progress has been made in this domain by leveraging classification based…

Information Retrieval · Computer Science 2024-08-30 Panfeng Cao , Pietro Lio

Cooperative control of groups of autonomous vehicles (AVs), i.e., platoons, is a promising direction to improving the efficiency of autonomous transportation systems. In this context, distributed co-optimization of both vehicle speed and…

Systems and Control · Electrical Eng. & Systems 2026-01-27 Samuel Mallick , Gianpietro Battocletti , Dimitris Boskos , Azita Dabiri , Bart De Schutter

Many modern sequential recommender systems use deep neural networks, which can effectively estimate the relevance of items but require a lot of time to train. Slow training increases expenses, hinders product development timescales and…

Information Retrieval · Computer Science 2022-07-18 Aleksandr Petrov , Craig Macdonald