English
Related papers

Related papers: Cached Long Short-Term Memory Neural Networks for …

200 papers

Recurrent Neural Networks (RNNs) with Long Short-Term Memory units (LSTM) are widely used because they are expressive and are easy to train. Our interest lies in empirically evaluating the expressiveness and the learnability of LSTMs in the…

Neural and Evolutionary Computing · Computer Science 2015-11-24 Wojciech Zaremba , Ilya Sutskever

Recently, several methods have been proposed to explain the predictions of recurrent neural networks (RNNs), in particular of LSTMs. The goal of these methods is to understand the network's decisions by assigning to each input variable,…

Machine Learning · Computer Science 2019-06-05 Leila Arras , Ahmed Osman , Klaus-Robert Müller , Wojciech Samek

Deep neural networks have achieved great success in computer vision, speech recognition and many other areas. The potential of recurrent neural networks especially the Long Short-Term Memory (LSTM) for open set communication signal…

Signal Processing · Electrical Eng. & Systems 2020-02-28 Youwei Guo , Hongyu Jiang , Jing Wu , Jie Zhou

Previous approaches to training syntax-based sentiment classification models required phrase-level annotated corpora, which are not readily available in many languages other than English. Thus, we propose the use of tree-structured Long…

Computation and Language · Computer Science 2018-10-02 Ryosuke Miyazaki , Mamoru Komachi

We propose in this paper a combined model of Long Short Term Memory and Convolutional Neural Networks (LSTM-CNN) that exploits word embeddings and positional embeddings for cross-sentence n-ary relation extraction. The proposed model brings…

Information Retrieval · Computer Science 2018-11-05 Angrosh Mandya , Danushka Bollegala , Frans Coenen , Katie Atkinson

The latent knowledge in the emotions and the opinions of the individuals that are manifested via social networks are crucial to numerous applications including social management, dynamical processes, and public security. Affective…

Machine Learning · Computer Science 2021-06-04 Sara Kamran , Raziyeh Zall , Mohammad Reza Kangavari , Saeid Hosseini , Sana Rahmani , Wen Hua

Recognizing named entities in a document is a key task in many NLP applications. Although current state-of-the-art approaches to this task reach a high performance on clean text (e.g. newswire genres), those algorithms dramatically degrade…

Computation and Language · Computer Science 2019-06-11 Gustavo Aguilar , A. Pastor López-Monroy , Fabio A. González , Thamar Solorio

Curriculum Learning emphasizes the order of training instances in a computational learning setup. The core hypothesis is that simpler instances should be learned early as building blocks to learn more complex ones. Despite its usefulness,…

Computation and Language · Computer Science 2016-11-21 Volkan Cirik , Eduard Hovy , Louis-Philippe Morency

Image captioning often requires a large set of training image-sentence pairs. In practice, however, acquiring sufficient training pairs is always expensive, making the recent captioning models limited in their ability to describe objects…

Computer Vision and Pattern Recognition · Computer Science 2017-08-18 Ting Yao , Yingwei Pan , Yehao Li , Tao Mei

Existing neural conversational models process natural language primarily on a lexico-syntactic level, thereby ignoring one of the most crucial components of human-to-human dialogue: its affective content. We take a step in this direction by…

Computation and Language · Computer Science 2017-09-14 Nabiha Asghar , Pascal Poupart , Jesse Hoey , Xin Jiang , Lili Mou

Sentiment analysis (SA) using code-mixed data from social media has several applications in opinion mining ranging from customer satisfaction to social campaign analysis in multilingual societies. Advances in this area are impeded by the…

Computation and Language · Computer Science 2016-11-03 Ameya Prabhu , Aditya Joshi , Manish Shrivastava , Vasudeva Varma

Recent neural-network-based architectures for image segmentation make extensive usage of feature forwarding mechanisms to integrate information from multiple scales. Although yielding good results, even deeper architectures and alternative…

Computer Vision and Pattern Recognition · Computer Science 2018-06-06 Fausto Milletari , Nicola Rieke , Maximilian Baust , Marco Esposito , Nassir Navab

This paper examines memory mechanisms in Large Language Models (LLMs), emphasizing their importance for context-rich responses, reduced hallucinations, and improved efficiency. It categorizes memory into sensory, short-term, and long-term,…

Computation and Language · Computer Science 2025-04-25 Lianlei Shan , Shixian Luo , Zezhou Zhu , Yu Yuan , Yong Wu

Automatic affect recognition is a challenging task due to the various modalities emotions can be expressed with. Applications can be found in many domains including multimedia retrieval and human computer interaction. In recent years, deep…

Computer Vision and Pattern Recognition · Computer Science 2018-02-14 Panagiotis Tzirakis , George Trigeorgis , Mihalis A. Nicolaou , Björn Schuller , Stefanos Zafeiriou

The transcription of handwritten text on images is one task in machine learning and one solution to solve it is using multi-dimensional recurrent neural networks (MDRNN) with connectionist temporal classification (CTC). The RNNs can contain…

Artificial Intelligence · Computer Science 2019-08-28 G. Leifert , T. Strauß , T. Grüning , R. Labahn

Text categorization is the task of assigning labels to documents written in a natural language, and it has numerous real-world applications including sentiment analysis as well as traditional topic assignment tasks. In this paper, we…

Computation and Language · Computer Science 2020-03-05 Changzeng Fu , Chaoran Liu , Carlos Toshinori Ishi , Yuichiro Yoshikawa , Hiroshi Ishiguro

This paper introduces a visual sentiment concept classification method based on deep convolutional neural networks (CNNs). The visual sentiment concepts are adjective noun pairs (ANPs) automatically discovered from the tags of web photos,…

Computer Vision and Pattern Recognition · Computer Science 2014-11-03 Tao Chen , Damian Borth , Trevor Darrell , Shih-Fu Chang

This paper proposes an intelligent cache management strategy based on CNN-LSTM to improve the performance and cache hit rate of storage systems. Through comparative experiments with traditional algorithms (such as LRU and LFU) and other…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-11-20 Xiaoye Wang , Xuan Li , Linji Wang , Tingyi Ruan , Pochun Li

The identification of sensory cues associated with potential opportunities and dangers is frequently complicated by unrelated events that separate useful cues by long delays. As a result, it remains a challenging task for state-of-the-art…

Neural and Evolutionary Computing · Computer Science 2023-07-17 Shimin Zhang , Qu Yang , Chenxiang Ma , Jibin Wu , Haizhou Li , Kay Chen Tan

Lifelong learning has recently attracted attention in building machine learning systems that continually accumulate and transfer knowledge to help future learning. Unsupervised topic modeling has been popularly used to discover topics from…

Computation and Language · Computer Science 2023-06-28 Pankaj Gupta , Yatin Chaudhary , Thomas Runkler , Hinrich Schütze