English
Related papers

Related papers: Recurrent Neural Networks with Top-k Gains for Ses…

200 papers

Recurrent Neural Networks (RNNs) are a key technology for applications such as automatic speech recognition or machine translation. Unlike conventional feed-forward DNNs, RNNs remember past information to improve the accuracy of future…

Neural and Evolutionary Computing · Computer Science 2022-02-16 Franyell Silfa , Jose-Maria Arnau , Antonio González

Recurrent neural networks (RNNs) are important class of architectures among neural networks useful for language modeling and sequential prediction. However, optimizing RNNs is known to be harder compared to feed-forward neural networks. A…

Machine Learning · Statistics 2018-03-29 Konrad Zolna , Devansh Arpit , Dendi Suhubdy , Yoshua Bengio

Recurrent Neural Networks (RNNs) are popular models of brain function. The typical training strategy is to adjust their input-output behavior so that it matches that of the biological circuit of interest. Even though this strategy ensures…

Neurons and Cognition · Quantitative Biology 2020-11-09 Alessandro Salatiello , Martin A. Giese

Sequential Recommender Systems (SRSs) are a popular type of recommender system that learns from a user's history to predict the next item they are likely to interact with. However, user interactions can be affected by noise stemming from…

Information Retrieval · Computer Science 2024-04-18 Andrea Bacciu , Federico Siciliano , Nicola Tonellotto , Fabrizio Silvestri

Random Neural Networks (RNNs) are a class of Neural Networks (NNs) that can also be seen as a specific type of queuing network. They have been successfully used in several domains during the last 25 years, as queuing networks to analyze the…

Neural and Evolutionary Computing · Computer Science 2016-09-19 Sebastián Basterrech , Gerardo Rubino

Recurrent neural networks (RNNs) are powerful models of sequential data. They have been successfully used in domains such as text and speech. However, RNNs are susceptible to overfitting; regularization is important. In this paper we…

Machine Learning · Statistics 2018-07-16 Adji B. Dieng , Rajesh Ranganath , Jaan Altosaar , David M. Blei

We propose tensorial neural networks (TNNs), a generalization of existing neural networks by extending tensor operations on low order operands to those on high order ones. The problem of parameter learning is challenging, as it corresponds…

Machine Learning · Statistics 2018-12-11 Jiahao Su , Jingling Li , Bobby Bhattacharjee , Furong Huang

Session-Based Recommenders (SBRs) aim to predict users' next preferences regard to their previous interactions in sessions while there is no historical information about them. Modern SBRs utilize deep neural networks to map users' current…

Information Retrieval · Computer Science 2023-12-18 Reza Yeganegi , Saman Haratizadeh

The problem of session-aware recommendation aims to predict users' next click based on their current session and historical sessions. Existing session-aware recommendation methods have defects in capturing complex item transition…

Information Retrieval · Computer Science 2021-01-28 Mengqi Zhang , Shu Wu , Meng Gao , Xin Jiang , Ke Xu , Liang Wang

Linear recurrent neural networks, such as State Space Models (SSMs) and Linear Recurrent Units (LRUs), have recently shown state-of-the-art performance on long sequence modelling benchmarks. Despite their success, their empirical…

Machine Learning · Computer Science 2024-10-08 Kai Biegun , Rares Dolga , Jake Cunningham , David Barber

In this paper, we propose a recurrent neural network (RNN) with residual attention (RRA) to learn long-range dependencies from sequential data. We propose to add residual connections across timesteps to RNN, which explicitly enhances the…

Machine Learning · Computer Science 2017-09-19 Cheng Wang

State-of-the-art sequential recommendation relies heavily on self-attention-based recommender models. Yet such models are computationally expensive and often too slow for real-time recommendation. Furthermore, the self-attention operation…

Information Retrieval · Computer Science 2023-11-09 Zhenrui Yue , Yueqi Wang , Zhankui He , Huimin Zeng , Julian McAuley , Dong Wang

To address the sequential changes of images including poses, in this paper we propose a recurrent regression neural network(RRNN) framework to unify two classic tasks of cross-pose face recognition on still images and video-based face…

Computer Vision and Pattern Recognition · Computer Science 2016-07-26 Yang Li , Wenming Zheng , Zhen Cui

Different from the traditional recommender system, the session-based recommender system introduces the concept of the session, i.e., a sequence of interactions between a user and multiple items within a period, to preserve the user's recent…

Information Retrieval · Computer Science 2021-07-12 Ruihong Qiu , Zi Huang , Jingjing Li , Hongzhi Yin

Recurrent Neural Networks (RNNs) are used to learn representations in partially observable environments. For agents that learn online and continually interact with the environment, it is desirable to train RNNs with real-time recurrent…

Machine Learning · Computer Science 2024-10-31 Esraa Elelimy , Adam White , Michael Bowling , Martha White

Recurrent neural networks (RNNs) are widely used in computational neuroscience and machine learning applications. In an RNN, each neuron computes its output as a nonlinear function of its integrated input. While the importance of RNNs,…

Neurons and Cognition · Quantitative Biology 2012-07-10 Sebastian Bitzer , Stefan J. Kiebel

A key attribute that drives the unprecedented success of modern Recurrent Neural Networks (RNNs) on learning tasks which involve sequential data, is their ability to model intricate long-term temporal dependencies. However, a well…

Machine Learning · Computer Science 2018-06-07 Yoav Levine , Or Sharir , Alon Ziv , Amnon Shashua

Many modern sequential recommender systems use deep neural networks, which can effectively estimate the relevance of items but require a lot of time to train. Slow training increases expenses, hinders product development timescales and…

Information Retrieval · Computer Science 2022-07-18 Aleksandr Petrov , Craig Macdonald

Given e-commerce scenarios that user profiles are invisible, session-based recommendation is proposed to generate recommendation results from short sessions. Previous work only considers the user's sequential behavior in the current…

Information Retrieval · Computer Science 2017-11-15 Jing Li , Pengjie Ren , Zhumin Chen , Zhaochun Ren , Jun Ma

With the explosive growth of online information, recommender systems play a key role to alleviate such information overload. Due to the important application value of recommender systems, there have always been emerging works in this field.…

Information Retrieval · Computer Science 2022-04-05 Shiwen Wu , Fei Sun , Wentao Zhang , Xu Xie , Bin Cui