English
Related papers

Related papers: Lightweight Self-Attentive Sequential Recommendati…

200 papers

Approximate nearest neighbor (ANN) search is widely used in the retrieval stage of large-scale recommendation systems. In this stage, candidate items are indexed using their learned embedding vectors, and ANN search is executed for each…

The state-of-the-art recommendation systems have shifted the attention to efficient recommendation, e.g., on-device recommendation, under memory constraints. To this end, the existing methods either focused on the lightweight embeddings for…

Information Retrieval · Computer Science 2025-03-20 Yang Wang , Haipeng Liu , Zeqian Yi , Biao Qian , Meng Wang

Recurrent neural networks (RNNs) are widely used as a memory model for sequence-related problems. Many variants of RNN have been proposed to solve the gradient problems of training RNNs and process long sequences. Although some classical…

Neural and Evolutionary Computing · Computer Science 2020-05-29 Chenpeng Zhang , Shuai Li , Mao Ye , Ce Zhu , Xue Li

Neural networks equipped with self-attention have parallelizable computation, light-weight structure, and the ability to capture both long-range and local dependencies. Further, their expressive power and performance can be boosted by using…

Computation and Language · Computer Science 2019-03-27 Tao Shen , Tianyi Zhou , Guodong Long , Jing Jiang , Chengqi Zhang

This paper proposes an attention module augmented relational network called SARN(Sequential Attention Relational Network) that can carry out relational reasoning by extracting reference objects and making efficient pairing between objects.…

Machine Learning · Computer Science 2018-11-02 Jinwon An , Sungwon Lyu , Sungzoon Cho

Capturing the temporal dynamics of user preferences over items is important for recommendation. Existing methods mainly assume that all time steps in user-item interaction history are equally relevant to recommendation, which however does…

Information Retrieval · Computer Science 2017-09-08 Wenjie Pei , Jie Yang , Zhu Sun , Jie Zhang , Alessandro Bozzon , David M. J. Tax

In modern social media platforms, an effective content recommendation should benefit both creators to bring genuine benefits to them and consumers to help them get really interesting content. To address the limitations of existing methods…

Social and Information Networks · Computer Science 2020-12-10 Wenyi Xiao , Huan Zhao , Haojie Pan , Yangqiu Song , Vincent W. Zheng , Qiang Yang

Linear attention mechanisms have gained prominence in causal language models due to their linear computational complexity and enhanced speed. However, the inherent decay mechanism in linear attention presents challenges when applied to…

Computation and Language · Computer Science 2024-06-03 Zhen Qin , Yuxin Mao , Xuyang Shen , Dong Li , Jing Zhang , Yuchao Dai , Yiran Zhong

Learning a matching function between two text sequences is a long standing problem in NLP research. This task enables many potential applications such as question answering and paraphrase identification. This paper proposes Co-Stack…

Computation and Language · Computer Science 2018-10-09 Yi Tay , Luu Anh Tuan , Siu Cheung Hui

Sequential recommendation techniques provide users with product recommendations fitting their current preferences by handling dynamic user preferences over time. Previous studies have focused on modeling sequential dynamics without much…

Information Retrieval · Computer Science 2021-05-25 Seongwon Jang , Hoyeop Lee , Hyunsouk Cho , Sehee Chung

Given e-commerce scenarios that user profiles are invisible, session-based recommendation is proposed to generate recommendation results from short sessions. Previous work only considers the user's sequential behavior in the current…

Information Retrieval · Computer Science 2017-11-15 Jing Li , Pengjie Ren , Zhumin Chen , Zhaochun Ren , Jun Ma

Standard deep neural networks (DNNs) are commonly trained in an end-to-end fashion for specific tasks such as object recognition, face identification, or character recognition, among many examples. This specificity often leads to…

Computer Vision and Pattern Recognition · Computer Science 2020-07-14 Raphaël Achddou , J. Matias di Martino , Guillermo Sapiro

The changing preferences of users towards items trigger the emergence of session-based recommender systems (SBRSs), which aim to model the dynamic preferences of users for next-item recommendations. However, most of the existing studies on…

Information Retrieval · Computer Science 2021-07-21 Wenzhuo Song , Shoujin Wang , Yan Wang , Shengsheng Wang

Retrieval, the initial stage of a recommendation system, is tasked with down-selecting items from a pool of tens of millions of candidates to a few thousands. Embedding Based Retrieval (EBR) has been a typical choice for this problem,…

Attention mechanism of late has been quite popular in the computer vision community. A lot of work has been done to improve the performance of the network, although almost always it results in increased computational complexity. In this…

Computer Vision and Pattern Recognition · Computer Science 2021-08-12 Abhinav Sagar

Embedding based product recommendations have gained popularity in recent years due to its ability to easily integrate to large-scale systems and allowing nearest neighbor searches in real-time. The bulk of studies in this area has…

Information Retrieval · Computer Science 2022-11-30 Giorgi Kvernadze , Putu Ayu G. Sudyanti , Nishan Subedi , Mohammad Hajiaghayi

Characterizing users' interests accurately plays a significant role in an effective recommender system. The sequential recommender system can learn powerful hidden representations of users from successive user-item interactions and dynamic…

Social and Information Networks · Computer Science 2020-11-24 Lingxiao Zhang , Jiangpeng Yan , Yujiu Yang , Xiu Li

The aim of this work is to introduce simplicial attention networks (SANs), i.e., novel neural architectures that operate on data defined on simplicial complexes leveraging masked self-attentional layers. Hinging on formal arguments from…

Machine Learning · Computer Science 2022-03-29 L. Giusti , C. Battiloro , P. Di Lorenzo , S. Sardellitti , S. Barbarossa

Recommender systems (RS) suggest items-based on the estimated preferences of users. Recent RS methods utilise vector space embeddings and deep learning methods to make efficient recommendations. However, most of these methods overlook the…

Information Retrieval · Computer Science 2020-09-01 Makbule Gulcin Ozsoy

With the rapid development of recommender systems, there is increasing side information that can be employed to improve the recommendation performance. Specially, we focus on the utilization of the associated \emph{textual data} of items…

Information Retrieval · Computer Science 2024-02-29 Lanling Xu , Zhen Tian , Bingqian Li , Junjie Zhang , Jinpeng Wang , Mingchen Cai , Wayne Xin Zhao