English
Related papers

Related papers: Learning to Structure Long-term Dependence for Seq…

200 papers

Large Language Models (LLMs) have emerged as a new paradigm for recommendation by converting interacted item history into language modeling. However, constrained by the limited context length of LLMs, existing approaches have to truncate…

Information Retrieval · Computer Science 2025-05-20 Jiayi Liao , Ruobing Xie , Sihang Li , Xiang Wang , Xingwu Sun , Zhanhui Kang , Xiangnan He

Multi-behavior recommendation aims to predict user conversions by modeling various interaction types that carry distinct intent signals. Recently, generative sequence modeling methods have emerged as an important paradigm for multi-behavior…

Information Retrieval · Computer Science 2026-04-28 Wenxuan Yang , Xiaoyang Xu , Hanyu Zhang , Zhexuan Xu , Wanqiang Xiong , Zhaoqun Chen

Session-based recommendation is a challenging problem in the real-world scenes, e.g., ecommerce, short video platforms, and music platforms, which aims to predict the next click action based on the anonymous session. Recently, graph neural…

Information Retrieval · Computer Science 2022-03-15 Guanghui Zhu , Haojun Hou , Jingfan Chen , Chunfeng Yuan , Yihua Huang

Representation and learning of long-range dependencies is a central challenge confronted in modern applications of machine learning to sequence data. Yet despite the prominence of this issue, the basic problem of measuring long-range…

Machine Learning · Statistics 2019-06-10 Alexander Greaves-Tunnell , Zaid Harchaoui

Deep learning has brought great progress for the sequential recommendation (SR) tasks. With advanced network architectures, sequential recommender models can be stacked with many hidden layers, e.g., up to 100 layers on real-world…

Information Retrieval · Computer Science 2021-05-13 Jiachun Wang , Fajie Yuan , Jian Chen , Qingyao Wu , Min Yang , Yang Sun , Guoxiao Zhang

We propose a novel method called Long Expressive Memory (LEM) for learning long-term sequential dependencies. LEM is gradient-based, it can efficiently process sequential tasks with very long-term dependencies, and it is sufficiently…

Machine Learning · Computer Science 2022-02-28 T. Konstantin Rusch , Siddhartha Mishra , N. Benjamin Erichson , Michael W. Mahoney

The recent advancements in Large Language Models (LLMs) have generated considerable interest in their utilization for sequential recommendation tasks. While collaborative signals from similar users are central to recommendation modeling,…

Information Retrieval · Computer Science 2025-04-15 Tong Zhang

Generative Recommendation (GR) models treat a user's interaction history as a sequence to be autoregressively predicted. When both items and actions (e.g., watch time, purchase, comment) are modeled, the layout-the ordering and visibility…

Information Retrieval · Computer Science 2025-10-21 Xiaokai Wei , Jiajun Wu , Daiyao Yi , Reza Shirkavand , Michelle Gong

Dependency tree structures capture long-distance and syntactic relationships between words in a sentence. The syntactic relations (e.g., nominal subject, object) can potentially infer the existence of certain named entities. In addition,…

Computation and Language · Computer Science 2019-09-24 Zhanming Jie , Wei Lu

Learning controllable and generalizable representation of multivariate data with desired structural properties remains a fundamental problem in machine learning. In this paper, we present a novel framework for learning generative models…

Machine Learning · Computer Science 2020-10-05 Ruixiang Zhang , Masanori Koyama , Katsuhiko Ishiguro

Message-passing architectures struggle to sufficiently model long-range dependencies in node and graph prediction tasks. We propose a novel approach exploiting hierarchical graph structures and adaptive random walks to address this…

Machine Learning · Computer Science 2025-09-03 Joël Mathys , Federico Errica

Session-based recommendation aims to predict a user's next action based on previous actions in the current session. The major challenge is to capture authentic and complete user preferences in the entire session. Recent work utilizes graph…

Information Retrieval · Computer Science 2022-01-11 Jiayan Guo , Yaming Yang , Xiangchen Song , Yuan Zhang , Yujing Wang , Jing Bai , Yan Zhang

Strategic recommendations (SR) refer to the problem where an intelligent agent observes the sequential behaviors and activities of users and decides when and how to interact with them to optimize some long-term objectives, both for the user…

Machine Learning · Computer Science 2020-09-17 Georgios Theocharous , Yash Chandak , Philip S. Thomas , Frits de Nijs

Sequential recommendation refers to recommending the next item of interest for a specific user based on his/her historical behavior sequence up to a certain time. While previous research has extensively examined Markov chain-based…

Information Retrieval · Computer Science 2025-01-06 DongYu Du , Yue Chan

Recently, significant progress has been made in sequential recommendation with deep learning. Existing neural sequential recommendation models usually rely on the item prediction loss to learn model parameters or data representations.…

Information Retrieval · Computer Science 2020-08-19 Kun Zhou , Hui Wang , Wayne Xin Zhao , Yutao Zhu , Sirui Wang , Fuzheng Zhang , Zhongyuan Wang , Ji-Rong Wen

In this paper, we study the effect of long memory in the learnability of a sequential recommender system including users' implicit feedback. We propose an online algorithm, where model parameters are updated user per user over blocks of…

Information Retrieval · Computer Science 2021-12-07 Aleksandra Burashnikova , Marianne Clausel , Massih-Reza Amini , Yury Maximov , Nicolas Dante

Representation learning in sequential recommendation is critical for accurately modeling user interaction patterns and improving recommendation precision. However, existing approaches predominantly emphasize item-to-item transitions, often…

Information Retrieval · Computer Science 2024-07-17 Yang Liu , Yitong Wang , Chenyue Feng

User response prediction, which models the user preference w.r.t. the presented items, plays a key role in online services. With two-decade rapid development, nowadays the cumulated user behavior sequences on mature Internet service…

Information Retrieval · Computer Science 2019-05-14 Kan Ren , Jiarui Qin , Yuchen Fang , Weinan Zhang , Lei Zheng , Weijie Bian , Guorui Zhou , Jian Xu , Yong Yu , Xiaoqiang Zhu , Kun Gai

Recommender systems are one of the most successful applications of machine learning and data science. They are successful in a wide variety of application domains, including e-commerce, media streaming content, email marketing, and…

Information Retrieval · Computer Science 2023-04-04 Juan Pablo Equihua , Maged Ali , Henrik Nordmark , Berthold Lausen

In order to build efficient deep recurrent neural architectures, it is essential to analyze the complexityof long distance dependencies (LDDs) of the dataset being modeled. In this paper, we presentdetailed analysis of the dependency decay…

Machine Learning · Computer Science 2020-12-09 Abhijit Mahalunkar , John D. Kelleher