English
Related papers

Related papers: StackRec: Efficient Training of Very Deep Sequenti…

200 papers

Recently, large language models (LLMs) have been introduced into recommender systems (RSs), either to enhance traditional recommendation models (TRMs) or serve as recommendation backbones. However, existing LLM-based RSs often do not fully…

Information Retrieval · Computer Science 2025-05-27 Bowen Zheng , Xiaolei Wang , Enze Liu , Xi Wang , Lu Hongyu , Yu Chen , Wayne Xin Zhao , Ji-Rong Wen

Deep learning models have been used to support analytics beyond simple aggregation, where deeper and wider models have been shown to yield great results. These models consume a huge amount of memory and computational operations. However,…

Machine Learning · Computer Science 2021-04-22 Shaofeng Cai , Gang Chen , Beng Chin Ooi , Jinyang Gao

Given the increasing scale of model sizes, novel training strategies like gradual stacking [Gong et al., 2019, Reddi et al., 2023] have garnered interest. Stacking enables efficient training by gradually growing the depth of a model in…

Computation and Language · Computer Science 2024-10-01 Nikunj Saunshi , Stefani Karp , Shankar Krishnan , Sobhan Miryoosefi , Sashank J. Reddi , Sanjiv Kumar

Traditional sequential recommendation methods assume that users' sequence data is clean enough to learn accurate sequence representations to reflect user preferences. In practice, users' sequences inevitably contain noise (e.g., accidental…

Information Retrieval · Computer Science 2024-03-08 Chi Zhang , Qilong Han , Rui Chen , Xiangyu Zhao , Peng Tang , Hongtao Song

Ubiquitous personalized recommender systems are built to achieve two seemingly conflicting goals, to serve high quality content tailored to individual user's taste and to adapt quickly to the ever changing environment. The former requires a…

Information Retrieval · Computer Science 2021-08-31 Yunbo Ouyang , Jun Shi , Haichao Wei , Huiji Gao

Sequential recommendation (SR) aims to predict a user's next item preference by modeling historical interaction sequences. Recent advances often integrate frequency-domain modules to compensate for self-attention's low-pass nature by…

Information Retrieval · Computer Science 2025-11-17 Peng He , Yao Liu , Yanglei Gan , Run Lin , Tingting Dai , Qiao Liu , Xuexin Li

The training paradigm integrating large language models (LLM) is gradually reshaping sequential recommender systems (SRS) and has shown promising results. However, most existing LLM-enhanced methods rely on rich textual information on the…

Information Retrieval · Computer Science 2024-10-17 Dugang Liu , Shenxian Xian , Xiaolin Lin , Xiaolian Zhang , Hong Zhu , Yuan Fang , Zhen Chen , Zhong Ming

Deep learning techniques have shown promise in many domain applications. This paper proposes a novel deep reservoir computing framework, termed deep recurrent stochastic configuration network (DeepRSCN) for modelling nonlinear dynamic…

Machine Learning · Computer Science 2024-10-29 Gang Dang , Dianhui Wang

In this work, we propose a multi-stage training strategy for the development of deep learning algorithms applied to problems with multiscale features. Each stage of the pro-posed strategy shares an (almost) identical network structure and…

Numerical Analysis · Mathematics 2020-09-25 Eric Chung , Wing Tat Leung , Sai-Mang Pun , Zecheng Zhang

Learning user representations based on historical behaviors lies at the core of modern recommender systems. Recent advances in sequential recommenders have convincingly demonstrated high capability in extracting effective user…

Information Retrieval · Computer Science 2021-09-14 Shengyu Zhang , Dong Yao , Zhou Zhao , Tat-seng Chua , Fei Wu

BERT4Rec is an effective model for sequential recommendation based on the Transformer architecture. In the original publication, BERT4Rec claimed superiority over other available sequential recommendation approaches (e.g. SASRec), and it is…

Information Retrieval · Computer Science 2022-07-18 Aleksandr Petrov , Craig Macdonald

Sequential recommender systems (SRS) predict the next items that users may prefer based on user historical interaction sequences. Inspired by the rise of large language models (LLMs) in various AI applications, there is a surge of work on…

Information Retrieval · Computer Science 2024-10-17 CanYi Liu , Wei Li , Youchen , Zhang , Hui Li , Rongrong Ji

An online resource scheduling framework is proposed for minimizing the sum of weighted task latency for all the Internet of things (IoT) users, by optimizing offloading decision, transmission power and resource allocation in the large-scale…

Machine Learning · Computer Science 2020-04-16 Feibo Jiang , Kezhi Wang , Li Dong , Cunhua Pan , Kun Yang

Deep learning-based recommendation systems (e.g., DLRMs) are widely used AI models to provide high-quality personalized recommendations. Training data used for modern recommendation systems commonly includes categorical features taking on…

Information Retrieval · Computer Science 2026-01-06 Gopi Krishna Jha , Anthony Thomas , Nilesh Jain , Sameh Gobriel , Tajana Rosing , Ravi Iyer

The training process of neural networks is known to be time-consuming, and having a deep architecture only aggravates the issue. This process consists mostly of matrix operations, among which matrix multiplication is the bottleneck. Several…

Machine Learning · Computer Science 2025-06-17 Sana Ebrahimi , Rishi Advani , Abolfazl Asudeh

Modern recommender systems trained on domain-specific data often struggle to generalize across multiple domains. Cross-domain sequential recommendation has emerged as a promising research direction to address this challenge; however,…

Information Retrieval · Computer Science 2026-01-06 Hyunsoo Kim , Jaewan Moon , Seongmin Park , Jongwuk Lee

We present an overview of SURREAL-System, a reproducible, flexible, and scalable framework for distributed reinforcement learning (RL). The framework consists of a stack of four layers: Provisioner, Orchestrator, Protocol, and Algorithms.…

Machine Learning · Computer Science 2019-10-14 Linxi Fan , Yuke Zhu , Jiren Zhu , Zihua Liu , Orien Zeng , Anchit Gupta , Joan Creus-Costa , Silvio Savarese , Li Fei-Fei

Recursive Neural Networks are non-linear adaptive models that are able to learn deep structured information. However, these models have not yet been broadly accepted. This fact is mainly due to its inherent complexity. In particular, not…

Neural and Evolutionary Computing · Computer Science 2009-11-18 Alejandro Chinea

Sequential recommendation models, models that learn from chronological user-item interactions, outperform traditional recommendation models in many settings. Despite the success of sequential recommendation models, their robustness has…

Information Retrieval · Computer Science 2024-01-17 Juntao Tan , Shelby Heinecke , Zhiwei Liu , Yongjun Chen , Yongfeng Zhang , Huan Wang

Recent advancements in session-based recommendation models using deep learning techniques have demonstrated significant performance improvements. While they can enhance model sophistication and improve the relevance of recommendations, they…

Machine Learning · Computer Science 2024-11-15 Bhavtosh Rath , Pushkar Chennu , David Relyea , Prathyusha Kanmanth Reddy , Amit Pande
‹ Prev 1 3 4 5 6 7 10 Next ›