English
Related papers

Related papers: Deep Captioning with Multimodal Recurrent Neural N…

200 papers

We introduce a novel, simple convolution neural network (CNN) architecture - multi-group norm constraint CNN (MGNC-CNN) that capitalizes on multiple sets of word embeddings for sentence classification. MGNC-CNN extracts features from input…

Computation and Language · Computer Science 2016-03-29 Ye Zhang , Stephen Roller , Byron Wallace

Deep neural networks (DNNs) have been recently found popular for image captioning problems in remote sensing (RS). Existing DNN based approaches rely on the availability of a training set made up of a high number of RS images with their…

Computer Vision and Pattern Recognition · Computer Science 2020-10-14 Gencer Sumbul , Sonali Nayak , Begüm Demir

Image captioning has attracted considerable attention in recent years. However, little work has been done for game image captioning which has some unique characteristics and requirements. In this work we propose a novel game image…

Computer Vision and Pattern Recognition · Computer Science 2019-06-18 Jian Zheng , Sudha Krishnamurthy , Ruxin Chen , Min-Hung Chen , Zhenhao Ge , Xiaohua Li

Pixel-level labelling tasks, such as semantic segmentation, play a central role in image understanding. Recent approaches have attempted to harness the capabilities of deep learning techniques for image recognition to tackle pixel-level…

Computer Vision and Pattern Recognition · Computer Science 2016-04-15 Shuai Zheng , Sadeep Jayasumana , Bernardino Romera-Paredes , Vibhav Vineet , Zhizhong Su , Dalong Du , Chang Huang , Philip H. S. Torr

Object detection, scene graph generation and region captioning, which are three scene understanding tasks at different semantic levels, are tied together: scene graphs are generated on top of objects detected in an image with their pairwise…

Computer Vision and Pattern Recognition · Computer Science 2017-09-18 Yikang Li , Wanli Ouyang , Bolei Zhou , Kun Wang , Xiaogang Wang

Image captioning aims to automatically generate a natural language description of a given image, and most state-of-the-art models have adopted an encoder-decoder framework. The framework consists of a convolution neural network (CNN)-based…

Computer Vision and Pattern Recognition · Computer Science 2019-05-21 Jun Yu , Jing Li , Zhou Yu , Qingming Huang

Designed as extremely deep architectures, deep residual networks which provide a rich visual representation and offer robust convergence behaviors have recently achieved exceptional performance in numerous computer vision problems. Being…

Computer Vision and Pattern Recognition · Computer Science 2017-04-13 T. Hoang Ngan Le , Chi Nhan Duong , Ligong Han , Khoa Luu , Marios Savvides , Dipan Pal

Image reconstruction and captioning from brain activity evoked by visual stimuli allow researchers to further understand the connection between the human brain and the visual perception system. While deep generative models have recently…

Computer Vision and Pattern Recognition · Computer Science 2023-08-16 Weijian Mai , Zhijun Zhang

In this paper we present our model on the task of emotion detection in textual conversations in SemEval-2019. Our model extends the Recurrent Convolutional Neural Network (RCNN) by using external fine-tuned word representations and DeepMoji…

Computation and Language · Computer Science 2019-04-03 Peixiang Zhong , Chunyan Miao

Although Recurrent Neural Network (RNN) has been a powerful tool for modeling sequential data, its performance is inadequate when processing sequences with multiple patterns. In this paper, we address this challenge by introducing a novel…

Machine Learning · Computer Science 2019-02-28 Kui Zhao , Yuechuan Li , Chi Zhang , Cheng Yang , Huan Xu

Recurrent neural networks (RNN) are popular for many computer vision tasks, including multi-label classification. Since RNNs produce sequential outputs, labels need to be ordered for the multi-label classification task. Current approaches…

Computer Vision and Pattern Recognition · Computer Science 2020-03-13 Vacit Oguz Yazici , Abel Gonzalez-Garcia , Arnau Ramisa , Bartlomiej Twardowski , Joost van de Weijer

Recurrent neural networks (RNNs) have achieved state-of-the-art performances in many natural language processing tasks, such as language modeling and machine translation. However, when the vocabulary is large, the RNN model will become very…

Computation and Language · Computer Science 2016-11-01 Xiang Li , Tao Qin , Jian Yang , Tie-Yan Liu

Computational models of vision have traditionally been developed in a bottom-up fashion, by hierarchically composing a series of straightforward operations - i.e. convolution and pooling - with the aim of emulating simple and complex cells…

Computer Vision and Pattern Recognition · Computer Science 2022-03-23 Simone Azeglio , Simone Poetto , Luca Savant Aira , Marco Nurisso

While recent deep neural network models have achieved promising results on the image captioning task, they rely largely on the availability of corpora with paired image and sentence captions to describe objects in context. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2016-04-29 Lisa Anne Hendricks , Subhashini Venugopalan , Marcus Rohrbach , Raymond Mooney , Kate Saenko , Trevor Darrell

Most of the information is stored as text, so text mining is regarded as having high commercial potential. Aiming at the semantic constraint problem of classification methods based on sparse representation, we propose a weighted recurrent…

Information Retrieval · Computer Science 2019-10-01 Dan Wang , Jibing Gong , Yaxi Song

With the rapid development of natural language processing technologies, more and more text steganographic methods based on automatic text generation technology have appeared in recent years. These models use the powerful self-learning and…

Multimedia · Computer Science 2020-01-08 Zhongliang Yang , Ke Wang , Jian Li , Yongfeng Huang , Yu-Jin Zhang

Long short-term memory (LSTM) recurrent neural networks (RNNs) have been shown to give state-of-the-art performance on many speech recognition tasks, as they are able to provide the learned dynamically changing contextual window of all…

Computation and Language · Computer Science 2016-10-12 Xiangang Li , Xihong Wu

Automatically creating the description of an image using any natural languages sentence like English is a very challenging task. It requires expertise of both image processing as well as natural language processing. This paper discuss about…

Computer Vision and Pattern Recognition · Computer Science 2018-10-03 Parth Shah , Vishvajit Bakarola , Supriya Pati

Nowadays, neural networks play an important role in the task of relation classification. By designing different neural architectures, researchers have improved the performance to a large extent in comparison with traditional methods.…

Computation and Language · Computer Science 2016-10-14 Yan Xu , Ran Jia , Lili Mou , Ge Li , Yunchuan Chen , Yangyang Lu , Zhi Jin

In this paper, we propose TopicRNN, a recurrent neural network (RNN)-based language model designed to directly capture the global semantic meaning relating words in a document via latent topics. Because of their sequential nature, RNNs are…

Computation and Language · Computer Science 2017-02-28 Adji B. Dieng , Chong Wang , Jianfeng Gao , John Paisley