English
Related papers

Related papers: Lightweight Self-Attentive Sequential Recommendati…

200 papers

We apply recurrent neural networks (RNN) on a new domain, namely recommender systems. Real-life recommender systems often face the problem of having to base recommendations only on short session-based data (e.g. a small sportsware website)…

Machine Learning · Computer Science 2016-03-30 Balázs Hidasi , Alexandros Karatzoglou , Linas Baltrunas , Domonkos Tikk

In this paper, we focus on the often-overlooked issue of embedding collapse in existing diffusion-based sequential recommendation models and propose ADRec, an innovative framework designed to mitigate this problem. Diverging from previous…

Information Retrieval · Computer Science 2025-05-27 Jialei Chen , Yuanbo Xu , Yiheng Jiang

Self-attention networks (SAN) have been introduced into automatic speech recognition (ASR) and achieved state-of-the-art performance owing to its superior ability in capturing long term dependency. One of the key ingredients is the…

Audio and Speech Processing · Electrical Eng. & Systems 2019-10-30 Zhao You , Dan Su , Jie Chen , Chao Weng , Dong Yu

Lane detection is a crucial perception task for all levels of automated vehicles (AVs) and Advanced Driver Assistance Systems, particularly in mixed-traffic environments where AVs must interact with human-driven vehicles (HDVs) and…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Sandeep Patil , Yongqi Dong , Haneen Farah , Hans Hellendoorn

In this paper, we propose a novel deep neural network framework embedded with low-level features (LCNN) for salient object detection in complex images. We utilise the advantage of convolutional neural networks to automatically learn the…

Computer Vision and Pattern Recognition · Computer Science 2015-08-18 Hongyang Li , Huchuan Lu , Zhe Lin , Xiaohui Shen , Brian Price

Image restoration is a long-standing task that seeks to recover the latent sharp image from its deteriorated counterpart. Due to the robust capacity of self-attention to capture long-range dependencies, transformer-based methods or some…

Computer Vision and Pattern Recognition · Computer Science 2024-07-29 Fangwei Hao , Jiesheng Wu , Ji Du , Yinjie Wang , Jing Xu

Lifelong user behavior sequences are crucial for capturing user interests and predicting user responses in modern recommendation systems. A two-stage paradigm is typically adopted to handle these long sequences: a subset of relevant…

Information Retrieval · Computer Science 2025-03-27 Ningya Feng , Junwei Pan , Jialong Wu , Baixu Chen , Ximei Wang , Qian Li , Xian Hu , Jie Jiang , Mingsheng Long

In the era of advancing information technology, recommender systems have emerged as crucial tools for dealing with information overload. However, traditional recommender systems still have limitations in capturing the dynamic evolution of…

Information Retrieval · Computer Science 2025-04-09 Mingjian Fu , Hengsheng Chen , Dongchun Jiang , Yanchao Tan

Deep learning has brought significant breakthroughs in sequential recommendation (SR) for capturing dynamic user interests. A series of recent research revealed that models with more parameters usually achieve optimal performance for SR…

Information Retrieval · Computer Science 2023-02-07 Zhiding Liu , Mingyue Cheng , Zhi Li , Qi Liu , Enhong Chen

The capability of the self-attention mechanism to model the long-range dependencies has catapulted its deployment in vision models. Unlike convolution operators, self-attention offers infinite receptive field and enables compute-efficient…

Computer Vision and Pattern Recognition · Computer Science 2020-06-29 Rajat Saini , Nandan Kumar Jha , Bedanta Das , Sparsh Mittal , C. Krishna Mohan

In this paper, we proposed large selective kernel and sparse attention network (LSKSANet) for remote sensing image semantic segmentation. The LSKSANet is a lightweight network that effectively combines convolution with sparse attention…

Image and Video Processing · Electrical Eng. & Systems 2024-06-04 Miao Fu , Feng Gao , Ruzhuang Hua , Yanhai Gan , Xiaowei Zhou , Yang Zhou

Nowadays, news apps have taken over the popularity of paper-based media, providing a great opportunity for personalization. Recurrent Neural Network (RNN)-based sequential recommendation is a popular approach that utilizes users' recent…

Information Retrieval · Computer Science 2020-04-13 Bing Bai , Guanhua Zhang , Ye Lin , Hao Li , Kun Bai , Bo Luo

Recently, conformer-based end-to-end automatic speech recognition, which outperforms recurrent neural network based ones, has received much attention. Although the parallel computing of conformer is more efficient than recurrent neural…

Sound · Computer Science 2021-07-26 Shengqiang Li , Menglong Xu , Xiao-Lei Zhang

Sequences and time-series often arise in robot tasks, e.g., in activity recognition and imitation learning. In recent years, deep neural networks (DNNs) have emerged as an effective data-driven methodology for processing sequences given…

Artificial Intelligence · Computer Science 2021-01-29 Yaqi Xie , Fan Zhou , Harold Soh

Recurrent Neural Networks (RNNs) have revolutionized many areas of machine learning, particularly in natural language and data sequence processing. Long Short-Term Memory (LSTM) has demonstrated its ability to capture long-term dependencies…

Machine Learning · Computer Science 2025-08-01 Remi Genet , Hugo Inzirillo

With the explosive growth of Internet data, users are facing the problem of information overload, which makes it a challenge to efficiently obtain the required resources. Recommendation systems have emerged in this context. By filtering…

Information Retrieval · Computer Science 2024-10-22 Wenyi Liu , Rui Wang , Yuanshuai Luo , Jianjun Wei , Zihao Zhao , Junming Huang

Sequential recommendation is a popular paradigm in modern recommender systems. In particular, one challenging problem in this space is cross-domain sequential recommendation (CDSR), which aims to predict future behaviors given user…

Information Retrieval · Computer Science 2025-05-29 Clark Mingxuan Ju , Leonardo Neves , Bhuvesh Kumar , Liam Collins , Tong Zhao , Yuwei Qiu , Qing Dou , Sohail Nizam , Sen Yang , Neil Shah

Sequential recommender systems are essential for discerning user preferences from historical interactions and facilitating targeted recommendations. Recent innovations employing Large Language Models (LLMs) have advanced the field by…

Information Retrieval · Computer Science 2024-09-04 Xinyu Zhang , Linmei Hu , Luhao Zhang , Dandan Song , Heyan Huang , Liqiang Nie

Modern deep learning-based recommendation systems exploit hundreds to thousands of different categorical features, each with millions of different categories ranging from clicks to posts. To respect the natural diversity within the…

Machine Learning · Computer Science 2020-06-30 Hao-Jun Michael Shi , Dheevatsa Mudigere , Maxim Naumov , Jiyan Yang

Sequential recommendation demonstrates the capability to recommend items by modeling the sequential behavior of users. Traditional methods typically treat users as sequences of items, overlooking the collaborative relationships among them.…

Information Retrieval · Computer Science 2023-08-15 Sijia Liu , Jiahao Liu , Hansu Gu , Dongsheng Li , Tun Lu , Peng Zhang , Ning Gu