English
Related papers

Related papers: BERT4Rec: Sequential Recommendation with Bidirecti…

200 papers

We propose a novel recommender framework, MuSTRec (Multimodal and Sequential Transformer-based Recommendation), that unifies multimodal and sequential recommendation paradigms. MuSTRec captures cross-item similarities and collaborative…

Information Retrieval · Computer Science 2026-02-10 Bucher Sahyouni , Matthew Vowels , Liqun Chen , Simon Hadfield

Sequential data such as time series, video, or text can be challenging to analyse as the ordered structure gives rise to complex dependencies. At the heart of this is non-commutativity, in the sense that reordering the elements of a…

Machine Learning · Computer Science 2021-08-02 Csaba Toth , Patric Bonnier , Harald Oberhauser

The integration of multimodal information into sequential recommender systems has attracted significant attention in recent research. In the initial stages of multimodal sequential recommendation models, the mainstream paradigm was…

Information Retrieval · Computer Science 2024-03-06 Jiaxi Hu , Jingtong Gao , Xiangyu Zhao , Yuehong Hu , Yuxuan Liang , Yiqi Wang , Ming He , Zitao Liu , Hongzhi Yin

Prior works have demonstrated that implicit representations trained only for reconstruction tasks typically generate encodings that are not useful for semantic tasks. In this work, we propose a method that contextualises the encodings of…

Computer Vision and Pattern Recognition · Computer Science 2023-05-23 Theo W. Costain , Kejie Li , Victor A. Prisacariu

Existing cross-encoder models can be categorized as pointwise, pairwise, or listwise. Pairwise and listwise models allow passage interactions, which typically makes them more effective than pointwise models but less efficient and less…

Recommender models aimed at mining users' behavioral patterns have raised great attention as one of the essential applications in daily life. Recent work on graph neural networks (GNNs) or debiasing methods has attained remarkable gains.…

Information Retrieval · Computer Science 2024-09-05 Xinfeng Wang , Fumiyo Fukumoto , Jin Cui , Yoshimi Suzuki , Jiyi Li , Dongjin Yu

The success of bidirectional encoders using masked language models, such as BERT, on numerous natural language processing tasks has prompted researchers to attempt to incorporate these pre-trained models into neural machine translation…

Computation and Language · Computer Science 2021-09-13 Haoran Xu , Benjamin Van Durme , Kenton Murray

The user purchase behaviors are mainly influenced by their intentions (e.g., buying clothes for decoration, buying brushes for painting, etc.). Modeling a user's latent intention can significantly improve the performance of recommendations.…

Information Retrieval · Computer Science 2023-11-28 Xiuyuan Qin , Huanhuan Yuan , Pengpeng Zhao , Guanfeng Liu , Fuzhen Zhuang , Victor S. Sheng

Click-Through Rate (CTR) prediction holds a pivotal place in online advertising and recommender systems since CTR prediction performance directly influences the overall satisfaction of the users and the revenue generated by companies. Even…

Information Retrieval · Computer Science 2024-05-22 Serdarcan Dilbaz , Hasan Saribas

Recent recommender systems increasingly leverage embeddings from large pre-trained language models (PLMs). However, such embeddings exhibit two key limitations: (1) PLMs are not explicitly optimized to produce structured and discriminative…

Computation and Language · Computer Science 2026-01-19 Guy Hadad , Neomi Rabaev , Bracha Shapira

Modern online service providers such as online shopping platforms often provide both search and recommendation (S&R) services to meet different user needs. Rarely has there been any effective means of incorporating user behavior data from…

Information Retrieval · Computer Science 2023-05-19 Zihua Si , Zhongxiang Sun , Xiao Zhang , Jun Xu , Xiaoxue Zang , Yang Song , Kun Gai , Ji-Rong Wen

Most spoken language understanding systems use a pipeline approach composed of an automatic speech recognition interface and a natural language understanding module. This approach forces hard decisions when converting continuous inputs into…

Computation and Language · Computer Science 2023-10-18 Quentin Meeus , Marie-Francine Moens , Hugo Van hamme

We explore the performance of Bidirectional Encoder Representations from Transformers (BERT) at definition extraction. We further propose a joint model of BERT and Text Level Graph Convolutional Network so as to incorporate dependencies…

Computation and Language · Computer Science 2020-09-18 Aadarsh Singh , Priyanshu Kumar , Aman Sinha

While behavior learning has made impressive progress in recent times, it lags behind computer vision and natural language processing due to its inability to leverage large, human-generated datasets. Human behaviors have wide variance,…

Machine Learning · Computer Science 2022-10-13 Nur Muhammad Mahi Shafiullah , Zichen Jeff Cui , Ariuntuya Altanzaya , Lerrel Pinto

Recent progress on parse tree encoder for sentence representation learning is notable. However, these works mainly encode tree structures recursively, which is not conducive to parallelization. On the other hand, these works rarely take…

Computation and Language · Computer Science 2022-05-10 Junhua Ma , Jiajun Li , Yuxuan Liu , Shangbo Zhou , Xue Li

The dichotomy between the challenging nature of obtaining annotations for activities, and the more straightforward nature of data collection from wearables, has resulted in significant interest in the development of techniques that utilize…

Machine Learning · Computer Science 2022-11-14 Harish Haresamudram , Irfan Essa , Thomas Ploetz

Sequential recommendation (SR) aims to model user preferences by capturing behavior patterns from their item historical interaction data. Most existing methods model user preference in the time domain, omitting the fact that users'…

Information Retrieval · Computer Science 2023-05-09 Xinyu Du , Huanhuan Yuan , Pengpeng Zhao , Junhua Fang , Guanfeng Liu , Yanchi Liu , Victor S. Sheng , Xiaofang Zhou

Machine-learning based recommender systems(RSs) has become an effective means to help people automatically discover their interests. Existing models often represent the rich information for recommendation, such as items, users, and…

Information Retrieval · Computer Science 2022-06-07 Zihua Si , Xueran Han , Xiao Zhang , Jun Xu , Yue Yin , Yang Song , Ji-Rong Wen

Sequential recommendation leverages interaction sequences to predict forthcoming user behaviors, crucial for crafting personalized recommendations. However, the true preferences of a user are inherently complex and high-dimensional, while…

Information Retrieval · Computer Science 2024-07-26 Shu Chen , Jinwei Luo , Weike Pan , Jiangxing Yu , Xin Huang , Zhong Ming

Sequential recommendation, where user preference is dynamically inferred from sequential historical behaviors, is a critical task in recommender systems (RSs). To further optimize long-term user engagement, offline…

Machine Learning · Computer Science 2024-08-16 Jun Wang , Likang Wu , Qi Liu , Yu Yang