中文
相关论文

相关论文: StackRec: Efficient Training of Very Deep Sequenti…

200 篇论文

Recently, large language models (LLMs) have been introduced into recommender systems (RSs), either to enhance traditional recommendation models (TRMs) or serve as recommendation backbones. However, existing LLM-based RSs often do not fully…

信息检索 · 计算机科学 2025-05-27 Bowen Zheng , Xiaolei Wang , Enze Liu , Xi Wang , Lu Hongyu , Yu Chen , Wayne Xin Zhao , Ji-Rong Wen

Deep learning models have been used to support analytics beyond simple aggregation, where deeper and wider models have been shown to yield great results. These models consume a huge amount of memory and computational operations. However,…

机器学习 · 计算机科学 2021-04-22 Shaofeng Cai , Gang Chen , Beng Chin Ooi , Jinyang Gao

Given the increasing scale of model sizes, novel training strategies like gradual stacking [Gong et al., 2019, Reddi et al., 2023] have garnered interest. Stacking enables efficient training by gradually growing the depth of a model in…

计算与语言 · 计算机科学 2024-10-01 Nikunj Saunshi , Stefani Karp , Shankar Krishnan , Sobhan Miryoosefi , Sashank J. Reddi , Sanjiv Kumar

Traditional sequential recommendation methods assume that users' sequence data is clean enough to learn accurate sequence representations to reflect user preferences. In practice, users' sequences inevitably contain noise (e.g., accidental…

信息检索 · 计算机科学 2024-03-08 Chi Zhang , Qilong Han , Rui Chen , Xiangyu Zhao , Peng Tang , Hongtao Song

Ubiquitous personalized recommender systems are built to achieve two seemingly conflicting goals, to serve high quality content tailored to individual user's taste and to adapt quickly to the ever changing environment. The former requires a…

信息检索 · 计算机科学 2021-08-31 Yunbo Ouyang , Jun Shi , Haichao Wei , Huiji Gao

Sequential recommendation (SR) aims to predict a user's next item preference by modeling historical interaction sequences. Recent advances often integrate frequency-domain modules to compensate for self-attention's low-pass nature by…

信息检索 · 计算机科学 2025-11-17 Peng He , Yao Liu , Yanglei Gan , Run Lin , Tingting Dai , Qiao Liu , Xuexin Li

The training paradigm integrating large language models (LLM) is gradually reshaping sequential recommender systems (SRS) and has shown promising results. However, most existing LLM-enhanced methods rely on rich textual information on the…

信息检索 · 计算机科学 2024-10-17 Dugang Liu , Shenxian Xian , Xiaolin Lin , Xiaolian Zhang , Hong Zhu , Yuan Fang , Zhen Chen , Zhong Ming

Deep learning techniques have shown promise in many domain applications. This paper proposes a novel deep reservoir computing framework, termed deep recurrent stochastic configuration network (DeepRSCN) for modelling nonlinear dynamic…

机器学习 · 计算机科学 2024-10-29 Gang Dang , Dianhui Wang

In this work, we propose a multi-stage training strategy for the development of deep learning algorithms applied to problems with multiscale features. Each stage of the pro-posed strategy shares an (almost) identical network structure and…

数值分析 · 数学 2020-09-25 Eric Chung , Wing Tat Leung , Sai-Mang Pun , Zecheng Zhang

Learning user representations based on historical behaviors lies at the core of modern recommender systems. Recent advances in sequential recommenders have convincingly demonstrated high capability in extracting effective user…

信息检索 · 计算机科学 2021-09-14 Shengyu Zhang , Dong Yao , Zhou Zhao , Tat-seng Chua , Fei Wu

BERT4Rec is an effective model for sequential recommendation based on the Transformer architecture. In the original publication, BERT4Rec claimed superiority over other available sequential recommendation approaches (e.g. SASRec), and it is…

信息检索 · 计算机科学 2022-07-18 Aleksandr Petrov , Craig Macdonald

Sequential recommender systems (SRS) predict the next items that users may prefer based on user historical interaction sequences. Inspired by the rise of large language models (LLMs) in various AI applications, there is a surge of work on…

信息检索 · 计算机科学 2024-10-17 CanYi Liu , Wei Li , Youchen , Zhang , Hui Li , Rongrong Ji

An online resource scheduling framework is proposed for minimizing the sum of weighted task latency for all the Internet of things (IoT) users, by optimizing offloading decision, transmission power and resource allocation in the large-scale…

机器学习 · 计算机科学 2020-04-16 Feibo Jiang , Kezhi Wang , Li Dong , Cunhua Pan , Kun Yang

Deep learning-based recommendation systems (e.g., DLRMs) are widely used AI models to provide high-quality personalized recommendations. Training data used for modern recommendation systems commonly includes categorical features taking on…

信息检索 · 计算机科学 2026-01-06 Gopi Krishna Jha , Anthony Thomas , Nilesh Jain , Sameh Gobriel , Tajana Rosing , Ravi Iyer

The training process of neural networks is known to be time-consuming, and having a deep architecture only aggravates the issue. This process consists mostly of matrix operations, among which matrix multiplication is the bottleneck. Several…

机器学习 · 计算机科学 2025-06-17 Sana Ebrahimi , Rishi Advani , Abolfazl Asudeh

Modern recommender systems trained on domain-specific data often struggle to generalize across multiple domains. Cross-domain sequential recommendation has emerged as a promising research direction to address this challenge; however,…

信息检索 · 计算机科学 2026-01-06 Hyunsoo Kim , Jaewan Moon , Seongmin Park , Jongwuk Lee

We present an overview of SURREAL-System, a reproducible, flexible, and scalable framework for distributed reinforcement learning (RL). The framework consists of a stack of four layers: Provisioner, Orchestrator, Protocol, and Algorithms.…

机器学习 · 计算机科学 2019-10-14 Linxi Fan , Yuke Zhu , Jiren Zhu , Zihua Liu , Orien Zeng , Anchit Gupta , Joan Creus-Costa , Silvio Savarese , Li Fei-Fei

Recursive Neural Networks are non-linear adaptive models that are able to learn deep structured information. However, these models have not yet been broadly accepted. This fact is mainly due to its inherent complexity. In particular, not…

神经与进化计算 · 计算机科学 2009-11-18 Alejandro Chinea

Sequential recommendation models, models that learn from chronological user-item interactions, outperform traditional recommendation models in many settings. Despite the success of sequential recommendation models, their robustness has…

信息检索 · 计算机科学 2024-01-17 Juntao Tan , Shelby Heinecke , Zhiwei Liu , Yongjun Chen , Yongfeng Zhang , Huan Wang

Recent advancements in session-based recommendation models using deep learning techniques have demonstrated significant performance improvements. While they can enhance model sophistication and improve the relevance of recommendations, they…

机器学习 · 计算机科学 2024-11-15 Bhavtosh Rath , Pushkar Chennu , David Relyea , Prathyusha Kanmanth Reddy , Amit Pande