English
Related papers

Related papers: CNN+CNN: Convolutional Decoders for Image Captioni…

200 papers

News Image Captioning aims to create captions from news articles and images, emphasizing the connection between textual context and visual elements. Recognizing the significance of human faces in news images and the face-name co-occurrence…

Computer Vision and Pattern Recognition · Computer Science 2024-03-22 Tingyu Qu , Tinne Tuytelaars , Marie-Francine Moens

Captioning models are typically trained using the cross-entropy loss. However, their performance is evaluated on other metrics designed to better correlate with human assessments. Recently, it has been shown that reinforcement learning (RL)…

Computer Vision and Pattern Recognition · Computer Science 2017-12-29 Sang Phan , Gustav Eje Henter , Yusuke Miyao , Shin'ichi Satoh

We report on a series of experiments with convolutional neural networks (CNN) trained on top of pre-trained word vectors for sentence-level classification tasks. We show that a simple CNN with little hyperparameter tuning and static vectors…

Computation and Language · Computer Science 2014-09-04 Yoon Kim

Image captioning, an open research issue, has been evolved with the progress of deep neural networks. Convolutional neural networks (CNNs) and recurrent neural networks (RNNs) are employed to compute image features and generate natural…

Computer Vision and Pattern Recognition · Computer Science 2018-07-26 Boeun Kim , Young Han Lee , Hyedong Jung , Choongsang Cho

Recent models for image processing are using the Convolutional neural network (CNN) which requires a pixel per pixel analysis of the input image. This method works well. However, it is time-consuming if we have large images. To increase the…

Machine Learning · Computer Science 2019-12-10 Mohamed Karim Belaid

Convolutional Neural Networks (CNNs) are state-of-the-art models for document image classification tasks. However, many of these approaches rely on parameters and architectures designed for classifying natural images, which differ from…

Computer Vision and Pattern Recognition · Computer Science 2017-08-11 Chris Tensmeyer , Tony Martinez

This work presents and analyzes three convolutional neural network (CNN) models for efficient pixelwise classification of images. When using convolutional neural networks to classify single pixels in patches of a whole image, a lot of…

Computer Vision and Pattern Recognition · Computer Science 2015-09-14 Fabian Tschopp

Image captioning is an interdisciplinary research problem that stands between computer vision and natural language processing. The task is to generate a textual description of the content of an image. The typical model used for image…

Computer Vision and Pattern Recognition · Computer Science 2018-10-16 Loris Bazzani , Tobias Domhan , Felix Hieber

Neural Machine Translation model is a sequence-to-sequence converter based on neural networks. Existing models use recurrent neural networks to construct both the encoder and decoder modules. In alternative research, the recurrent networks…

Computation and Language · Computer Science 2021-05-04 Ritam Mallick , Seba Susan , Vaibhaw Agrawal , Rizul Garg , Prateek Rawal

Recurrent neural networks have recently been used for learning to describe images using natural language. However, it has been observed that these models generalize poorly to scenes that were not observed during training, possibly depending…

Computer Vision and Pattern Recognition · Computer Science 2016-08-30 Yuval Atzmon , Jonathan Berant , Vahid Kezami , Amir Globerson , Gal Chechik

Speech emotion recognition is a challenging task and heavily depends on hand-engineered acoustic features, which are typically crafted to echo human perception of speech signals. However, a filter bank that is designed from perceptual…

Sound · Computer Science 2020-07-29 Siddique Latif , Rajib Rana , Sara Khalifa , Raja Jurdak , Julien Epps

Context in image is crucial for scene labeling while existing methods only exploit local context generated from a small surrounding area of an image patch or a pixel, by contrast long-range and global contextual information is ignored. To…

Computer Vision and Pattern Recognition · Computer Science 2016-08-12 Heng Fan , Xue Mei , Danil Prokhorov , Haibin Ling

Generating eye diagrams by using a circuit simulator can be very computationally intensive, especially in the presence of nonlinearities. It often involves multiple Newton-like iterations at every time step when a SPICE-like circuit…

Signal Processing · Electrical Eng. & Systems 2019-02-11 Thong Nguyen , Tianjian Lu , Ken Wu , Jose Schutt-Aine

In this paper, we propose a novel convolutional neural network (CNN) architecture considering both local and global features for image enhancement. Most conventional image enhancement methods, including Retinex-based methods, cannot restore…

Image and Video Processing · Electrical Eng. & Systems 2019-05-09 Yuma Kinoshita , Hitoshi Kiya

Digital histology images are amenable to the application of convolutional neural network (CNN) for analysis due to the sheer size of pixel data present in them. CNNs are generally used for representation learning from small image patches…

Image and Video Processing · Electrical Eng. & Systems 2019-07-24 Muhammad Shaban , Ruqayya Awan , Muhammad Moazam Fraz , Ayesha Azam , David Snead , Nasir M. Rajpoot

We consider referring image segmentation. It is a problem at the intersection of computer vision and natural language understanding. Given an input image and a referring expression in the form of a natural language sentence, the goal is to…

Computer Vision and Pattern Recognition · Computer Science 2020-02-03 Linwei Ye , Zhi Liu , Yang Wang

Recurrent neural networks (RNNs) have shown the ability to improve scene parsing through capturing long-range dependencies among image units. In this paper, we propose dense RNNs for scene labeling by exploring various long-range semantic…

Computer Vision and Pattern Recognition · Computer Science 2018-11-13 Heng Fan , Peng Chu , Longin Jan Latecki , Haibin Ling

Semantic labeling (or pixel-level land-cover classification) in ultra-high resolution imagery (< 10cm) requires statistical models able to learn high level concepts from spatial data, with large appearance variations. Convolutional Neural…

Computer Vision and Pattern Recognition · Computer Science 2017-03-08 Michele Volpi , Devis Tuia

Generating a novel textual description of an image is an interesting problem that connects computer vision and natural language processing. In this paper, we present a simple model that is able to generate descriptive sentences given a…

Computation and Language · Computer Science 2015-04-10 Rémi Lebret , Pedro O. Pinheiro , Ronan Collobert

The Convolution Neural Network (CNN) has demonstrated the unique advantage in audio, image and text learning; recently it has also challenged Recurrent Neural Networks (RNNs) with long short-term memory cells (LSTM) in sequence-to-sequence…

Computation and Language · Computer Science 2017-12-29 Qiming Chen , Ren Wu