English
Related papers

Related papers: MTGenRec: An Efficient Distributed Training System…

200 papers

We consider the optimization of distributed resource scheduling to minimize the sum of task latency and energy consumption for all the Internet of things devices (IoTDs) in a large-scale mobile edge computing (MEC) system. To address this…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-05-27 Feibo Jiang , Li Dong , Kezhi Wang , Kun Yang , Cunhua Pan

In recommendation systems, practitioners observed that increase in the number of embedding tables and their sizes often leads to significant improvement in model performances. Given this and the business importance of these models to major…

Machine Learning · Computer Science 2020-10-26 Jie Amy Yang , Jianyu Huang , Jongsoo Park , Ping Tak Peter Tang , Andrew Tulloch

Sequential recommendation aims to predict a user's next action in large-scale recommender systems. While traditional methods often suffer from insufficient information interaction, recent generative recommendation models partially address…

Information Retrieval · Computer Science 2026-02-10 Haibo Xing , Hao Deng , Yucheng Mao , Lingyu Mu , Jinxin Hu , Yi Xu , Hao Zhang , Jiahao Wang , Shizhun Wang , Yu Zhang , Xiaoyi Zeng , Jing Zhang

Reinforcement Learning-based recommender systems (RLRS) offer an effective way to handle sequential recommendation tasks but often face difficulties in real-world settings, where user feedback data can be sub-optimal or sparse. In this…

Information Retrieval · Computer Science 2025-10-16 Xiaocong Chen , Siyu Wang , Lina Yao

Contemporary recommendation systems are designed to meet users' needs by delivering tailored lists of items that align with their specific demands or interests. In a multi-stage recommendation system, reranking plays a crucial role by…

Information Retrieval · Computer Science 2025-03-26 Yuxin Ren , Qiya Yang , Yichun Wu , Wei Xu , Yalong Wang , Zhiqiang Zhang

As an intelligent infrastructure connecting users with commercial content, advertising recommendation systems play a central role in information flow and value creation within the digital economy. However, existing multi-stage advertising…

Modern recommender systems face significant computational challenges due to growing model complexity and traffic scale, making efficient computation allocation critical for maximizing business revenue. Existing approaches typically simplify…

Information Retrieval · Computer Science 2026-01-01 Wan Jiang , Xinyi Zang , Yudong Zhao , Yusi Zou , Yunfei Lu , Junbo Tong , Yang Liu , Ming Li , Jiani Shi , Xin Yang

Personalized recommendation is a ubiquitous application on the internet, with many industries and hyperscalers extensively leveraging Deep Learning Recommendation Models (DLRMs) for their personalization needs (like ad serving or movie…

Hardware Architecture · Computer Science 2024-10-30 Rishabh Jain , Vivek M. Bhasi , Adwait Jog , Anand Sivasubramaniam , Mahmut T. Kandemir , Chita R. Das

Generative recommendation is emerging as a powerful paradigm that directly generates item predictions, moving beyond traditional matching-based approaches. However, current methods face two key challenges: token-item misalignment, where…

Information Retrieval · Computer Science 2025-06-24 Chang Liu , Yimeng Bai , Xiaoyan Zhao , Yang Zhang , Fuli Feng , Wenge Rong

Recent recommender systems increasingly leverage embeddings from large pre-trained language models (PLMs). However, such embeddings exhibit two key limitations: (1) PLMs are not explicitly optimized to produce structured and discriminative…

Computation and Language · Computer Science 2026-01-19 Guy Hadad , Neomi Rabaev , Bracha Shapira

The recent success of large language models (LLMs) has renewed interest in whether recommender systems can achieve similar scaling benefits. Conventional recommenders, dominated by massive embedding tables, tend to plateau as embedding…

Information Retrieval · Computer Science 2025-10-29 Xiaoyu Kong , Leheng Sheng , Junfei Tan , Yuxin Chen , Jiancan Wu , An Zhang , Xiang Wang , Xiangnan He

Generative recommendation has recently emerged as a promising paradigm in information retrieval. However, generative ranking systems are still understudied, particularly with respect to their effectiveness and feasibility in large-scale…

Sequential recommendation is an important recommendation task that aims to predict the next item in a sequence. Recently, adaptations of language models, particularly Transformer-based models such as SASRec and BERT4Rec, have achieved…

Information Retrieval · Computer Science 2023-06-21 Aleksandr V. Petrov , Craig Macdonald

The memory capacity of embedding tables in deep learning recommendation models (DLRMs) is increasing dramatically from tens of GBs to TBs across the industry. Given the fast growth in DLRMs, novel solutions are urgently needed, in order to…

Machine Learning · Computer Science 2021-01-29 Chunxing Yin , Bilge Acun , Xing Liu , Carole-Jean Wu

Recently, generative retrieval-based recommendation systems have emerged as a promising paradigm. However, most modern recommender systems adopt a retrieve-and-rank strategy, where the generative model functions only as a selector during…

Information Retrieval · Computer Science 2025-02-27 Jiaxin Deng , Shiyao Wang , Kuo Cai , Lejian Ren , Qigen Hu , Weifeng Ding , Qiang Luo , Guorui Zhou

The integration of reinforcement learning (RL) into large language models (LLMs) has opened new opportunities for recommender systems by eliciting reasoning and improving user preference modeling. However, RL-based LLM recommendation faces…

Information Retrieval · Computer Science 2026-02-05 Lin Wang , Yang Zhang , Jingfan Chen , Xiaoyan Zhao , Fengbin Zhu , Qing Li , Tat-Seng Chua

In a multi-stage recommendation system, reranking plays a crucial role in modeling intra-list correlations among items. A key challenge lies in exploring optimal sequences within the combinatorial space of permutations. Recent research…

Information Retrieval · Computer Science 2025-10-30 Zhijie Lin , Zhuofeng Li , Chenglei Dai , Wentian Bao , Shuai Lin , Enyun Yu , Haoxiang Zhang , Liang Zhao

Inductive transfer learning has had a big impact on computer vision and NLP domains but has not been used in the area of recommender systems. Even though there has been a large body of research on generating recommendations based on…

Information Retrieval · Computer Science 2020-06-11 Fajie Yuan , Xiangnan He , Alexandros Karatzoglou , Liguang Zhang

Recommendation models rely on deep learning networks and large embedding tables, resulting in computationally and memory-intensive processes. These models are typically trained using hybrid CPU-GPU or GPU-only configurations. The hybrid…

Hardware Architecture · Computer Science 2024-04-30 Muhammad Adnan , Yassaman Ebrahimzadeh Maboud , Divya Mahajan , Prashant J. Nair

The integration of generative AI models, particularly large language models (LLMs), into real-time multi-model AI applications such as video conferencing and gaming is giving rise to a new class of workloads: real-time generative AI…

Machine Learning · Computer Science 2025-07-22 Rachid Karami , Rajeev Patwari , Hyoukjun Kwon , Ashish Sirasao