中文
相关论文

相关论文: Enhancing Transformers without Self-supervised Lea…

200 篇论文

Sequential Recommendation (SR) plays a pivotal role in recommender systems by tailoring recommendations to user preferences based on their non-stationary historical interactions. Achieving high-quality performance in SR requires attention…

信息检索 · 计算机科学 2024-08-23 Wuchao Li , Rui Huang , Haijun Zhao , Chi Liu , Kai Zheng , Qi Liu , Na Mou , Guorui Zhou , Defu Lian , Yang Song , Wentian Bao , Enyun Yu , Wenwu Ou

Sequential patterns play an important role in building modern recommender systems. To this end, several recommender systems have been built on top of Markov Chains and Recurrent Models (among others). Although these sequential models have…

信息检索 · 计算机科学 2019-08-28 An Yan , Shuo Cheng , Wang-Cheng Kang , Mengting Wan , Julian McAuley

Modeling the complex interactions between users and items as well as amongst items themselves is at the core of designing successful recommender systems. One classical setting is predicting users' personalized sequential behavior (or…

信息检索 · 计算机科学 2017-07-11 Ruining He , Wang-Cheng Kang , Julian McAuley

Sequential recommenders that are trained on implicit feedback are usually learned as a multi-class classification task through softmax-based loss functions on one-hot class labels. However, one-hot training labels are sparse and may lead to…

信息检索 · 计算机科学 2023-11-07 Shiguang Wu , Xin Xin , Pengjie Ren , Zhumin Chen , Jun Ma , Maarten de Rijke , Zhaochun Ren

While some powerful neural network architectures (e.g., Transformer, Graph Neural Networks) have achieved improved performance in sequential recommendation with high-order item dependency modeling, they may suffer from poor representation…

信息检索 · 计算机科学 2023-06-02 Yaowen Ye , Lianghao Xia , Chao Huang

Transformer-based models have achieved remarkable results in low-level vision tasks including image super-resolution (SR). However, early Transformer-based approaches that rely on self-attention within non-overlapping windows encounter…

图像与视频处理 · 电气工程与系统科学 2024-04-18 Cansu Korkmaz , A. Murat Tekalp

Sequential recommender systems must model long-range user behavior while operating under strict memory and latency constraints. Transformer-based approaches achieve strong accuracy but suffer from quadratic attention complexity, forcing…

Sequential recommendation systems are integral to discerning temporal user preferences. Yet, the task of learning from abbreviated user interaction sequences poses a notable challenge. Data augmentation has been identified as a potent…

信息检索 · 计算机科学 2025-02-25 Juyong Jiang , Peiyan Zhang , Yingtao Luo , Chaozhuo Li , Jae Boum Kim , Kai Zhang , Senzhang Wang , Sunghun Kim , Philip S. Yu

Adaptations of Transformer models, such as BERT4Rec and SASRec, achieve state-of-the-art performance in the sequential recommendation task according to accuracy-based metrics, such as NDCG. These models treat items as tokens and then…

信息检索 · 计算机科学 2024-03-11 Aleksandr Petrov , Craig Macdonald

Deep neural networks often suffer from poor generalization caused by complex and non-convex loss landscapes. One of the popular solutions is Sharpness-Aware Minimization (SAM), which smooths the loss landscape via minimizing the maximized…

机器学习 · 计算机科学 2022-10-25 Peng Mi , Li Shen , Tianhe Ren , Yiyi Zhou , Xiaoshuai Sun , Rongrong Ji , Dacheng Tao

In sequential recommendation (SR), system exposure refers to items that are exposed to the user. Typically, only a few of the exposed items would be interacted with by the user. Although SR has achieved great success in predicting future…

信息检索 · 计算机科学 2025-04-21 Ziqi Zhao , Zhaochun Ren , Jiyuan Yang , Zuming Yan , Zihan Wang , Liu Yang , Pengjie Ren , Zhumin Chen , Maarten de Rijke , Xin Xin

Sequential recommendation is a task to capture hidden user preferences from historical user item interaction data and recommend next items for the user. Significant progress has been made in this domain by leveraging classification based…

信息检索 · 计算机科学 2024-08-30 Panfeng Cao , Pietro Lio

This work introduces TRON, a scalable session-based Transformer Recommender using Optimized Negative-sampling. Motivated by the scalability and performance limitations of prevailing models such as SASRec and GRU4Rec+, TRON integrates top-k…

信息检索 · 计算机科学 2025-04-01 Timo Wilm , Philipp Normann , Sophie Baumeister , Paul-Vincent Kobow

Transformers have been successfully applied to the visual tracking task and significantly promote tracking performance. The self-attention mechanism designed to model long-range dependencies is the key to the success of Transformers.…

计算机视觉与模式识别 · 计算机科学 2022-05-10 Zhihong Fu , Zehua Fu , Qingjie Liu , Wenrui Cai , Yunhong Wang

Session-based recommender systems (SBRSs) have shown superior performance over conventional methods. However, they show limited scalability on large-scale industrial datasets since most models learn one embedding per item. This leads to a…

信息检索 · 计算机科学 2022-09-27 Walid Shalaby , Sejoon Oh , Amir Afsharinejad , Srijan Kumar , Xiquan Cui

Sequential recommendation systems aim to predict users' next preferences based on their interaction histories, but existing approaches face critical limitations in efficiency and multi-scale pattern recognition. While Transformer-based…

信息检索 · 计算机科学 2025-05-08 Qianru Zhang , Liang Qu , Honggang Wen , Dong Huang , Siu-Ming Yiu , Nguyen Quoc Viet Hung , Hongzhi Yin

Sequential recommender systems (SRSs) aim to predict the subsequent items which may interest users via comprehensively modeling users' complex preference embedded in the sequence of user-item interactions. However, most of existing SRSs…

信息检索 · 计算机科学 2024-10-31 Chengkai Huang , Shoujin Wang , Xianzhi Wang , Lina Yao

Sequential Recommendation (SeqRec) aims to predict the next item by capturing sequential patterns from users' historical interactions, playing a crucial role in many real-world recommender systems. However, existing approaches predominantly…

信息检索 · 计算机科学 2025-08-04 Jiakai Tang , Sunhao Dai , Teng Shi , Jun Xu , Xu Chen , Wen Chen , Jian Wu , Yuning Jiang

Sequential recommendation methods play a crucial role in modern recommender systems because of their ability to capture a user's dynamic interest from her/his historical interactions. Despite their success, we argue that these approaches…

信息检索 · 计算机科学 2021-03-02 Xu Xie , Fei Sun , Zhaoyang Liu , Shiwen Wu , Jinyang Gao , Bolin Ding , Bin Cui

In many real-world scenarios, data to train machine learning models becomes available over time. Unfortunately, these models struggle to continually learn new concepts without forgetting what has been learnt in the past. This phenomenon is…

计算与语言 · 计算机科学 2023-01-16 Beyza Ermis , Giovanni Zappella , Martin Wistuba , Aditya Rawal , Cedric Archambeau