English
Related papers

Related papers: LLaTTE: Scaling Laws for Multi-Stage Sequence Mode…

200 papers

Scaling of neural networks has recently shown great potential to improve the model capacity in various fields. Specifically, model performance has a power-law relationship with model size or data size, which provides important guidance for…

Information Retrieval · Computer Science 2023-11-21 Gaowei Zhang , Yupeng Hou , Hongyu Lu , Yu Chen , Wayne Xin Zhao , Ji-Rong Wen

Recent years have witnessed success of sequential modeling, generative recommender, and large language model for recommendation. Though the scaling law has been validated for sequential models, it showed inefficiency in computational…

While scaling laws promise significant performance gains for recommender systems, efficiently deploying hyperscale models remains a major unsolved challenge. In contrast to fields where FMs are already widely adopted such as natural…

Information Retrieval · Computer Science 2025-08-08 Dai Li , Kevin Course , Wei Li , Hongwei Li , Jie Hua , Yiqi Chen , Zhao Zhu , Rui Jian , Xuan Cao , Bi Xue , Yu Shi , Jing Qian , Kai Ren , Matt Ma , Qunshu Zhang , Rui Li

The explainability of recommendation systems is crucial for enhancing user trust and satisfaction. Leveraging large language models (LLMs) offers new opportunities for comprehensive recommendation logic generation. However, in existing…

Information Retrieval · Computer Science 2024-07-04 Hongke Zhao , Songming Zheng , Likang Wu , Bowen Yu , Jing Wang

This paper focuses on extending the success of large language models (LLMs) to sequential decision making. Existing efforts either (i) re-train or finetune LLMs for decision making, or (ii) design prompts for pretrained LLMs. The former…

Machine Learning · Computer Science 2025-06-17 Dingyang Chen , Qi Zhang , Yinglun Zhu

Large language models (LLMs) open up new horizons for sequential recommendations, owing to their remarkable language comprehension and generation capabilities. However, there are still numerous challenges that should be addressed to…

Information Retrieval · Computer Science 2024-03-29 Yuling Wang , Changxin Tian , Binbin Hu , Yanhua Yu , Ziqi Liu , Zhiqiang Zhang , Jun Zhou , Liang Pang , Xiao Wang

Transformer-based generative models have achieved remarkable success across domains with various scaling law manifestations. However, our extensive experiments reveal persistent challenges when applying Transformer to recommendation…

Information Retrieval · Computer Science 2025-08-29 Songpei Xu , Shijia Wang , Da Guo , Xianwen Guo , Qiang Xiao , Bin Huang , Guanlin Wu , Chuanjiang Luo

The importance of recommender systems is growing rapidly due to the exponential increase in the volume of content generated daily. This surge in content presents unique challenges for designing effective recommender systems. Key among these…

Computation and Language · Computer Science 2025-06-12 Jiahao Tian , Jinman Zhao , Zhenkai Wang , Zhicheng Ding

The sequential recommendation problem has attracted considerable research attention in the past few years, leading to the rise of numerous recommendation models. In this work, we explore how Large Language Models (LLMs), which are nowadays…

Information Retrieval · Computer Science 2025-01-14 Artun Boz , Wouter Zorgdrager , Zoe Kotti , Jesse Harte , Panos Louridas , Dietmar Jannach , Vassilios Karakoidas , Marios Fragkoulis

The recent breakthrough of large language models (LLMs) in natural language processing has sparked exploration in recommendation systems, however, their limited domain-specific knowledge remains a critical bottleneck. Specifically, LLMs…

Information Retrieval · Computer Science 2025-10-03 Xiaohan Yu , Li Zhang , Xin Zhao , Yue Wang

Harnessing the reasoning power of Large Language Models (LLMs) for recommender systems is hindered by two fundamental challenges. First, current approaches lack a mechanism for automated, data-driven discovery of effective reasoning…

Information Retrieval · Computer Science 2026-02-26 Jie Jiang , Yang Wu , Qian Li , Yuling Xiong , Hongbo Tang , Xun Liu , Haoze Wang , Jun Zhang , Huan Yu , Hailong Shi

Tabular data synthesis is crucial in machine learning, yet existing general methods-primarily based on statistical or deep learning models-are highly data-dependent and often fall short in recommender systems. This limitation arises from…

Information Retrieval · Computer Science 2025-02-12 Jingtong Gao , Zhaocheng Du , Xiaopeng Li , Yichao Wang , Xiangyang Li , Huifeng Guo , Ruiming Tang , Xiangyu Zhao

Large Language Models (LLMs) have shown strong potential in generating natural language explanations for recommender systems. However, existing methods often overlook the sequential dynamics of user behavior and rely on evaluation metrics…

Information Retrieval · Computer Science 2026-03-26 Gangyi Zhang , Runzhe Teng , Chongming Gao

Large Language Models (LLMs) present a critical trade-off between inference quality and computational cost: larger models offer superior capabilities but incur significant latency, while smaller models are faster but less powerful. Existing…

Machine Learning · Computer Science 2025-05-13 Hang Wu , Jianian Zhu , Yinghui Li , Haojie Wang , Biao Hou , Jidong Zhai

Click-Through Rate (CTR) prediction is crucial for Recommendation System(RS), aiming to provide personalized recommendation services for users in many aspects such as food delivery, e-commerce and so on. However, traditional RS relies on…

Information Retrieval · Computer Science 2024-08-22 Zhizhong Wan , Bin Yin , Junjie Xie , Fei Jiang , Xiang Li , Wei Lin

Driven by recent advances in artificial intelligence (AI), a growing literature has demonstrated the potential for using large language models (LLMs) as scalable surrogates to generate human-like responses in many business applications. Two…

Machine Learning · Computer Science 2025-12-30 Lei Wang , Zikun Ye , Jinglong Zhao

An effective online recommendation system should jointly capture users' long-term and short-term preferences in both users' internal behaviors (from the target recommendation task) and external behaviors (from other tasks). However, it is…

Information Retrieval · Computer Science 2021-11-29 Ruobing Xie , Yalong Wang , Rui Wang , Yuanfu Lu , Yuanhang Zou , Feng Xia , Leyu Lin

Recently, scaling test-time compute on Large Language Models (LLM) has garnered wide attention. However, there has been limited investigation of how various reasoning prompting strategies perform as scaling. In this paper, we focus on a…

Artificial Intelligence · Computer Science 2025-08-18 Yexiang Liu , Zekun Li , Zhi Fang , Nan Xu , Ran He , Tieniu Tan

The recent advancements in Large Language Models (LLMs) have generated considerable interest in their utilization for sequential recommendation tasks. While collaborative signals from similar users are central to recommendation modeling,…

Information Retrieval · Computer Science 2025-04-15 Tong Zhang

This study deeply explores the application of large language model (LLM) in personalized recommendation system of e-commerce. Aiming at the limitations of traditional recommendation algorithms in processing large-scale and multi-dimensional…

Information Retrieval · Computer Science 2024-10-18 Wei Xu , Jue Xiao , Jianlong Chen