English
Related papers

Related papers: Non-invasive Self-attention for Side Information F…

200 papers

The aim of session-based recommendation is to predict the users' next clicked item, which is a challenging task due to the inherent uncertainty in user behaviors and anonymous implicit feedback information. A powerful session-based…

Information Retrieval · Computer Science 2020-07-27 Jing Zhu , Yanan Xu , Yanmin Zhu

Although syntactic information is beneficial for many NLP tasks, combining it with contextual information between words to solve the coreference resolution problem needs to be further explored. In this paper, we propose an end-to-end parser…

Computation and Language · Computer Science 2023-09-12 Yuan Meng , Xuhao Pan , Jun Chang , Yue Wang

Initially introduced as a machine translation model, the Transformer architecture has now become the foundation for modern deep learning architecture, with applications in a wide range of fields, from computer vision to natural language…

Computation and Language · Computer Science 2024-06-21 Martin Courtois , Malte Ostendorff , Leonhard Hennig , Georg Rehm

Session-based recommendation aims to predict user's next behavior from current session and previous anonymous sessions. Capturing long-range dependencies between items is a vital challenge in session-based recommendation. A novel approach…

Information Retrieval · Computer Science 2021-02-04 Jun Fang

Language Models such as BERT have grown in popularity due to their ability to be pre-trained and perform robustly on a wide range of Natural Language Processing tasks. Often seen as an evolution over traditional word embedding techniques,…

Computation and Language · Computer Science 2022-06-30 Nimesh Bhana , Terence L. van Zyl

Deep neural models (e.g. Transformer) naturally learn spurious features, which create a ``shortcut'' between the labels and inputs, thus impairing the generalization and robustness. This paper advances the self-attention mechanism to its…

Computation and Language · Computer Science 2023-02-09 Hongqiu Wu , Ruixue Ding , Hai Zhao , Pengjun Xie , Fei Huang , Min Zhang

Although deep neural networks generally have fixed network structures, the concept of dynamic mechanism has drawn more and more attention in recent years. Attention mechanisms compute input-dependent dynamic attention weights for…

Machine Learning · Computer Science 2019-12-03 Lanqing Xue , Xiaopeng Li , Nevin L. Zhang

Side-information Integrated Sequential Recommendation (SISR) benefits from auxiliary item information to infer hidden user preferences, which is particularly effective for sparse interactions and cold-start scenarios. However, existing…

Information Retrieval · Computer Science 2025-05-21 Hye-young Kim , Minjin Choi , Sunkyung Lee , Ilwoong Baek , Jongwuk Lee

This article presents a "Hybrid Self-Attention NEAT" method to improve the original NeuroEvolution of Augmenting Topologies (NEAT) algorithm in high-dimensional inputs. Although the NEAT algorithm has shown a significant result in different…

Neural and Evolutionary Computing · Computer Science 2023-06-21 Saman Khamesian , Hamed Malek

Sequential recommendation (SR) models based on Transformers have achieved remarkable successes. The self-attention mechanism of Transformers for computer vision and natural language processing suffers from the oversmoothing problem, i.e.,…

Machine Learning · Computer Science 2024-02-20 Yehjin Shin , Jeongwhan Choi , Hyowon Wi , Noseong Park

Transformer-based pre-trained models, such as BERT, have shown extraordinary success in achieving state-of-the-art results in many natural language processing applications. However, deploying these models can be prohibitively costly, as the…

Computation and Language · Computer Science 2022-03-18 Jing Zhao , Yifan Wang , Junwei Bao , Youzheng Wu , Xiaodong He

Music streaming services heavily rely on their recommendation engines to continuously provide content to their consumers. Sequential recommendation consequently has seen considerable attention in current literature, where state of the art…

Information Retrieval · Computer Science 2024-01-22 Pavan Seshadri , Peter Knees

Recently, substantial research has been conducted on sequential recommendation, with the objective of forecasting the subsequent item by leveraging a user's historical sequence of interacted items. Prior studies employ both capsule networks…

Information Retrieval · Computer Science 2025-05-01 Zhikai Wang , Yanyan Shen

Recommender systems have become an essential tool to help resolve the information overload problem in recent decades. Traditional recommender systems, however, suffer from data sparsity and cold start problems. To address these issues, a…

Information Retrieval · Computer Science 2020-07-21 Zhu Sun , Qing Guo , Jie Yang , Hui Fang , Guibing Guo , Jie Zhang , Robin Burke

Attention mechanisms are becoming increasingly popular, being used in neural network models in multiple domains such as natural language processing (NLP) and vision applications, especially at the edge. However, attention layers are…

Hardware Architecture · Computer Science 2024-05-08 Mohit Upadhyay , Rohan Juneja , Weng-Fai Wong , Li-Shiuan Peh

Neural models that independently project questions and answers into a shared embedding space allow for efficient continuous space retrieval from large corpora. Independently computing embeddings for questions and answers results in late…

Computation and Language · Computer Science 2020-09-30 Yinfei Yang , Ning Jin , Kuo Lin , Mandy Guo , Daniel Cer

The ability to model intra-modal and inter-modal interactions is fundamental in multimodal machine learning. The current state-of-the-art models usually adopt deep learning models with fixed structures. They can achieve exceptional…

Computer Vision and Pattern Recognition · Computer Science 2023-06-27 Qingpei Guo , Kaisheng Yao , Wei Chu

With the explosive growth of Internet data, users are facing the problem of information overload, which makes it a challenge to efficiently obtain the required resources. Recommendation systems have emerged in this context. By filtering…

Information Retrieval · Computer Science 2024-10-22 Wenyi Liu , Rui Wang , Yuanshuai Luo , Jianjun Wei , Zihao Zhao , Junming Huang

In modern social media platforms, an effective content recommendation should benefit both creators to bring genuine benefits to them and consumers to help them get really interesting content. To address the limitations of existing methods…

Social and Information Networks · Computer Science 2020-12-10 Wenyi Xiao , Huan Zhao , Haojie Pan , Yangqiu Song , Vincent W. Zheng , Qiang Yang

With the rapid development of recommender systems, there is increasing side information that can be employed to improve the recommendation performance. Specially, we focus on the utilization of the associated \emph{textual data} of items…

Information Retrieval · Computer Science 2024-02-29 Lanling Xu , Zhen Tian , Bingqian Li , Junjie Zhang , Jinpeng Wang , Mingchen Cai , Wayne Xin Zhao
‹ Prev 1 3 4 5 6 7 10 Next ›