English
Related papers

Related papers: Sequential Recommendation via Stochastic Self-Atte…

200 papers

While self-attention has been instrumental in the success of Transformers, it can lead to over-concentration on a few tokens during training, resulting in suboptimal information flow. Enforcing doubly-stochastic constraints in attention…

Machine Learning · Computer Science 2025-07-15 Ashkan Shahbazi , Elaheh Akbari , Darian Salehi , Xinran Liu , Navid Naderializadeh , Soheil Kolouri

In this work, we consider solving optimization problems with a stochastic objective and deterministic equality constraints. We propose a Trust-Region Sequential Quadratic Programming method to find both first- and second-order stationary…

Optimization and Control · Mathematics 2024-09-27 Yuchen Fang , Sen Na , Michael W. Mahoney , Mladen Kolar

Sequential recommender systems rank relevant items by modeling a user's interaction history and computing the inner product between the resulting user representation and stored item embeddings. To avoid the significant memory overhead of…

Predicting users' preferences based on their sequential behaviors in history is challenging and crucial for modern recommender systems. Most existing sequential recommendation algorithms focus on transitional structure among the sequential…

Information Retrieval · Computer Science 2020-02-06 Jibang Wu , Renqin Cai , Hongning Wang

Session-based Recommendation (SR) aims to predict the next item for recommendation based on previously recorded sessions of user interaction. The majority of existing approaches to SR focus on modeling the transition patterns of items. In…

Information Retrieval · Computer Science 2022-04-06 Jiahao Yuan , Wendi Ji , Dell Zhang , Jinwei Pan , Xiaoling Wang

In many stochastic service systems, decision-makers find themselves making a sequence of decisions, with the number of decisions being unpredictable. To enhance these decisions, it is crucial to uncover the causal impact these decisions…

Methodology · Statistics 2023-07-18 Juan C. David Gomez , Amy L. Cochran , Gabriel Zayas-Caban

Sequential Recommendation characterizes the evolving patterns by modeling item sequences chronologically. The essential target of it is to capture the item transition correlations. The recent developments of transformer inspire the…

Information Retrieval · Computer Science 2021-05-04 Zhiwei Liu , Ziwei Fan , Yu Wang , Philip S. Yu

The goal of sequential recommendation (SR) is to predict a user's potential interested items based on her/his historical interaction sequences. Most existing sequential recommenders are developed based on ID features, which, despite their…

Information Retrieval · Computer Science 2023-10-24 Jinpeng Wang , Ziyun Zeng , Yunxiao Wang , Yuting Wang , Xingyu Lu , Tianxiang Li , Jun Yuan , Rui Zhang , Hai-Tao Zheng , Shu-Tao Xia

Learning the user-item relevance hidden in implicit feedback data plays an important role in modern recommender systems. Neural sequential recommendation models, which formulates learning the user-item relevance as a sequential…

Information Retrieval · Computer Science 2022-03-01 Jingwei Zhuo , Bin Liu , Xiang Li , Han Zhu , Xiaoqiang Zhu

The extraction of modular object-centric representations for downstream tasks is an emerging area of research. Learning grounded representations of objects that are guaranteed to be stable and invariant promises robust performance across…

Machine Learning · Computer Science 2024-01-26 Avinash Kori , Francesco Locatello , Fabio De Sousa Ribeiro , Francesca Toni , Ben Glocker

The chronological order of user-item interactions is a key feature in many recommender systems, where the items that users will interact may largely depend on those items that users just accessed recently. However, with the tremendous…

Information Retrieval · Computer Science 2019-06-24 Chen Ma , Peng Kang , Xue Liu

Sequential recommender systems (SRS) could capture dynamic user preferences by modeling historical behaviors ordered in time. Despite effectiveness, focusing only on the \textit{collaborative signals} from behaviors does not fully grasp…

Information Retrieval · Computer Science 2024-09-20 Mingyue Cheng , Hao Zhang , Qi Liu , Fajie Yuan , Zhi Li , Zhenya Huang , Enhong Chen , Jun Zhou , Longfei Li

This paper focuses on the contextual optimization problem where a decision is subject to some uncertain parameters and covariates that have some predictive power on those parameters are available before the decision is made. More…

Optimization and Control · Mathematics 2024-08-12 Zhaoen Li , Maoqi Liu , Zhi-Hai Zhang

Sequential dynamics are a key feature of many modern recommender systems, which seek to capture the `context' of users' activities on the basis of actions they have performed recently. To capture such patterns, two approaches have…

Information Retrieval · Computer Science 2018-08-30 Wang-Cheng Kang , Julian McAuley

Writing review for a purchased item is a unique channel to express a user's opinion in E-Commerce. Recently, many deep learning based solutions have been proposed by exploiting user reviews for rating prediction. In contrast, there has been…

Information Retrieval · Computer Science 2019-07-02 Chenliang Li , Xichuan Niu , Xiangyang Luo , Zhenzhong Chen , Cong Quan

Attention-based neural networks have achieved state-of-the-art results on a wide range of tasks. Most such models use deterministic attention while stochastic attention is less explored due to the optimization difficulties or complicated…

Machine Learning · Computer Science 2021-06-10 Shujian Zhang , Xinjie Fan , Bo Chen , Mingyuan Zhou

Top-$N$ sequential recommendation models each user as a sequence of items interacted in the past and aims to predict top-$N$ ranked items that a user will likely interact in a `near future'. The order of interaction implies that sequential…

Information Retrieval · Computer Science 2018-09-21 Jiaxi Tang , Ke Wang

Modern recommender systems perform large-scale retrieval by first embedding queries and item candidates in the same unified space, followed by approximate nearest neighbor search to select top candidates given a query embedding. In this…

We consider a general online stochastic optimization problem with multiple budget constraints over a horizon of finite time periods. In each time period, a reward function and multiple cost functions are revealed, and the decision maker…

Machine Learning · Computer Science 2022-07-26 Jiashuo Jiang , Xiaocheng Li , Jiawei Zhang

The goal of a recommendation system is to model the relevance between each user and each item through the user-item interaction history, so that maximize the positive samples score and minimize negative samples. Currently, two popular loss…

Information Retrieval · Computer Science 2022-07-08 Chun Yang , Shicai Fan