English
Related papers

Related papers: Describing Multimedia Content using Attention-base…

200 papers

Applying convolutional neural networks to large images is computationally expensive because the amount of computation scales linearly with the number of image pixels. We present a novel recurrent neural network model that is capable of…

Machine Learning · Computer Science 2014-06-25 Volodymyr Mnih , Nicolas Heess , Alex Graves , Koray Kavukcuoglu

Human visual system can selectively attend to parts of a scene for quick perception, a biological mechanism known as Human attention. Inspired by this, recent deep learning models encode attention mechanisms to focus on the most…

Computer Vision and Pattern Recognition · Computer Science 2020-07-07 Qiuxia Lai , Salman Khan , Yongwei Nie , Jianbing Shen , Hanqiu Sun , Ling Shao

Attention plays a fundamental role in both natural and artificial intelligence systems. In deep learning, attention-based neural architectures, such as transformer architectures, are widely used to tackle problems in natural language…

Machine Learning · Computer Science 2022-02-18 Pierre Baldi , Roman Vershynin

Graph neural networks are deep neural networks designed for graphs with attributes attached to nodes or edges. The number of research papers in the literature concerning these models is growing rapidly due to their impressive performance on…

Machine Learning · Computer Science 2024-12-30 James H. Tanis , Chris Giannella , Adrian V. Mariano

Recurrent neural networks (RNNs) have shown the ability to improve scene parsing through capturing long-range dependencies among image units. In this paper, we propose dense RNNs for scene labeling by exploring various long-range semantic…

Computer Vision and Pattern Recognition · Computer Science 2018-11-13 Heng Fan , Peng Chu , Longin Jan Latecki , Haibin Ling

Deep neural networks, including recurrent networks, have been successfully applied to human activity recognition. Unfortunately, the final representation learned by recurrent networks might encode some noise (irrelevant signal components,…

Machine Learning · Computer Science 2018-10-10 Ming Zeng , Haoxiang Gao , Tong Yu , Ole J. Mengshoel , Helge Langseth , Ian Lane , Xiaobing Liu

We describe an attentive encoder that combines tree-structured recursive neural networks and sequential recurrent neural networks for modelling sentence pairs. Since existing attentive models exert attention on the sequential structure, we…

Computation and Language · Computer Science 2016-10-11 Yao Zhou , Cong Liu , Yan Pan

Linear layers in neural networks (NNs) trained by gradient descent can be expressed as a key-value memory system which stores all training datapoints and the initial weights, and produces outputs using unnormalised dot attention over the…

Machine Learning · Computer Science 2022-06-20 Kazuki Irie , Róbert Csordás , Jürgen Schmidhuber

We propose a new encoder-decoder approach to learn distributed sentence representations that are applicable to multiple purposes. The model is learned by using a convolutional neural network as an encoder to map an input sentence into a…

Computation and Language · Computer Science 2017-07-28 Zhe Gan , Yunchen Pu , Ricardo Henao , Chunyuan Li , Xiaodong He , Lawrence Carin

Deep Neural networks are efficient and flexible models that perform well for a variety of tasks such as image, speech recognition and natural language understanding. In particular, convolutional neural networks (CNN) generate a keen…

Machine Learning · Computer Science 2018-12-20 Yesmina Jaafra , Jean Luc Laurent , Aline Deruyver , Mohamed Saber Naceur

Attention-based encoder-decoder neural network models have recently shown promising results in machine translation and speech recognition. In this work, we propose an attention-based neural network model for joint intent detection and slot…

Computation and Language · Computer Science 2016-09-07 Bing Liu , Ian Lane

With the advent of state of the art nature-inspired pure attention based models i.e. transformers, and their success in natural language processing (NLP), their extension to machine vision (MV) tasks was inevitable and much felt.…

Computer Vision and Pattern Recognition · Computer Science 2021-06-15 Abdul Mueed Hafiz , Shabir Ahmad Parah , Rouf Ul Alam Bhat

Intelligence necessitates memory. Without memory, humans fail to perform various nontrivial tasks such as reading novels, playing games or solving maths. As the ultimate goal of machine learning is to derive intelligent systems that learn…

Machine Learning · Computer Science 2021-07-06 Hung Le

We present an attention-based model for recognizing multiple objects in images. The proposed model is a deep recurrent neural network trained with reinforcement learning to attend to the most relevant regions of the input image. We show…

Machine Learning · Computer Science 2015-04-24 Jimmy Ba , Volodymyr Mnih , Koray Kavukcuoglu

Attention has long been proposed by psychologists as important for effectively dealing with the enormous sensory stimulus available in the neocortex. Inspired by the visual attention models in computational neuroscience and the need of…

Computer Vision and Pattern Recognition · Computer Science 2015-02-24 Yichuan Tang , Nitish Srivastava , Ruslan Salakhutdinov

Graph-structured data arise naturally in many different application domains. By representing data as graphs, we can capture entities (i.e., nodes) as well as their relationships (i.e., edges) with each other. Many useful insights can be…

Artificial Intelligence · Computer Science 2018-07-24 John Boaz Lee , Ryan A. Rossi , Sungchul Kim , Nesreen K. Ahmed , Eunyee Koh

Deep neural networks excel at finding hierarchical representations that solve complex tasks over large data sets. How can we humans understand these learned representations? In this work, we present network dissection, an analytic framework…

Computer Vision and Pattern Recognition · Computer Science 2020-09-15 David Bau , Jun-Yan Zhu , Hendrik Strobelt , Agata Lapedriza , Bolei Zhou , Antonio Torralba

A long time ago in the machine learning literature, the idea of incorporating a mechanism inspired by the human visual system into neural networks was introduced. This idea is named the attention mechanism, and it has gone through a long…

Machine Learning · Computer Science 2022-08-10 Derya Soydaner

Countless learning tasks require dealing with sequential data. Image captioning, speech synthesis, and music generation all require that a model produce outputs that are sequences. In other domains, such as time series prediction, video…

Machine Learning · Computer Science 2015-10-20 Zachary C. Lipton , John Berkowitz , Charles Elkan

While convolutional neural networks have gained impressive success recently in solving structured prediction problems such as semantic segmentation, it remains a challenge to differentiate individual object instances in the scene. Instance…

Machine Learning · Computer Science 2017-07-14 Mengye Ren , Richard S. Zemel