English
Related papers

Related papers: Recurrent Fusion Network for Image Captioning

200 papers

Automatically translating images to texts involves image scene understanding and language modeling. In this paper, we propose a novel model, termed RefineCap, that refines the output vocabulary of the language decoder using decoder-guided…

Computation and Language · Computer Science 2021-09-09 Yekun Chai , Shuo Jin , Junliang Xing

We propose a novel method for predicting image labels by fusing image content descriptors with the social media context of each image. An image uploaded to a social media site such as Flickr often has meaningful, associated information,…

Computer Vision and Pattern Recognition · Computer Science 2018-01-30 Chengjiang Long , Roddy Collins , Eran Swears , Anthony Hoogs

Image captioning is a fast-growing research field of computer vision and natural language processing that involves creating text explanations for images. This study aims to develop a system that uses a pre-trained convolutional neural…

Computation and Language · Computer Science 2022-03-04 Rashid Khan , M Shujah Islam , Khadija Kanwal , Mansoor Iqbal , Md. Imran Hossain , Zhongfu Ye

Typical techniques for video captioning follow the encoder-decoder framework, which can only focus on one source video being processed. A potential disadvantage of such design is that it cannot capture the multiple visual context…

Computer Vision and Pattern Recognition · Computer Science 2019-05-13 Wenjie Pei , Jiyuan Zhang , Xiangrong Wang , Lei Ke , Xiaoyong Shen , Yu-Wing Tai

Recently, much advance has been made in image captioning, and an encoder-decoder framework has achieved outstanding performance for this task. In this paper, we propose an extension of the encoder-decoder framework by adding a component…

Computer Vision and Pattern Recognition · Computer Science 2018-04-04 Wenhao Jiang , Lin Ma , Xinpeng Chen , Hanwang Zhang , Wei Liu

When taking photos in dim-light environments, due to the small amount of light entering, the shot images are usually extremely dark, with a great deal of noise, and the color cannot reflect real-world color. Under this condition, the…

Computer Vision and Pattern Recognition · Computer Science 2019-04-17 Di Zhao , Lan Ma , Songnan Li , Dahai Yu

The encoder-decoder networks are commonly used in medical image segmentation due to their remarkable performance in hierarchical feature fusion. However, the expanding path for feature decoding and spatial recovery does not consider the…

Image and Video Processing · Electrical Eng. & Systems 2019-11-22 Ying Wen , Kai Xie , Lianghua He

In recent years, the biggest advances in major Computer Vision tasks, such as object recognition, handwritten-digit identification, facial recognition, and many others., have all come through the use of Convolutional Neural Networks (CNNs).…

Computation and Language · Computer Science 2019-07-05 Elaina Tan , Lakshay Sharma

Remarkable progress has been achieved in image generation with the introduction of generative models. However, precisely controlling the content in generated images remains a challenging task due to their fundamental training objective.…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Giang H. Le , Anh Q. Nguyen , Byeongkeun Kang , Yeejin Lee

Recently, referring image segmentation has aroused widespread interest. Previous methods perform the multi-modal fusion between language and vision at the decoding side of the network. And, linguistic feature interacts with visual feature…

Computer Vision and Pattern Recognition · Computer Science 2021-05-06 Guang Feng , Zhiwei Hu , Lihe Zhang , Huchuan Lu

Image decomposition is a crucial subject in the field of image processing. It can extract salient features from the source image. We propose a new image decomposition method based on convolutional neural network. This method can be applied…

Computer Vision and Pattern Recognition · Computer Science 2022-08-04 Yu Fu , Xiao-Jun Wu , Josef Kittler

Image fusion methods and metrics for their evaluation have conventionally used pixel-based or low-level features. However, for many applications, the aim of image fusion is to effectively combine the semantic content of the input images.…

Computer Vision and Pattern Recognition · Computer Science 2021-10-14 P. R. Hill , D. R. Bull

In this paper, we present a multimodal Recurrent Neural Network (m-RNN) model for generating novel sentence descriptions to explain the content of images. It directly models the probability distribution of generating a word given previous…

Computer Vision and Pattern Recognition · Computer Science 2014-10-07 Junhua Mao , Wei Xu , Yi Yang , Jiang Wang , Alan L. Yuille

In this paper, we explore the application of Recurrent Neural Network (RNN) for still images. Typically, Convolutional Neural Networks (CNNs) are the prevalent method applied for this type of data, and more recently, transformers have…

Computer Vision and Pattern Recognition · Computer Science 2024-09-11 Dmitri , Lvov , Yair Smadar , Ran Bezen

Countless learning tasks require dealing with sequential data. Image captioning, speech synthesis, and music generation all require that a model produce outputs that are sequences. In other domains, such as time series prediction, video…

Machine Learning · Computer Science 2015-10-20 Zachary C. Lipton , John Berkowitz , Charles Elkan

Recently deep learning-based methods have been applied in image compression and achieved many promising results. In this paper, we propose an improved hybrid layered image compression framework by combining deep learning and the traditional…

Image and Video Processing · Electrical Eng. & Systems 2022-06-22 Haisheng Fu , Feng Liang , Bo Lei , Nai Bian , Qian zhang , Mohammad Akbari , Jie Liang , Chengjie Tu

Over the long history of machine learning, which dates back several decades, recurrent neural networks (RNNs) have been used mainly for sequential data and time series and generally with 1D information. Even in some rare studies on 2D…

Computer Vision and Pattern Recognition · Computer Science 2021-03-05 Nguyen Huu Phong , Bernardete Ribeiro

Two recent approaches have achieved state-of-the-art results in image captioning. The first uses a pipelined process where a set of candidate words is generated by a convolutional neural network (CNN) trained on images, and then a maximum…

Computation and Language · Computer Science 2015-10-16 Jacob Devlin , Hao Cheng , Hao Fang , Saurabh Gupta , Li Deng , Xiaodong He , Geoffrey Zweig , Margaret Mitchell

With the advent of mobile and hand-held cameras, document images have found their way into almost every domain. Dewarping of these images for the removal of perspective distortions and folds is essential so that they can be understood by…

Computer Vision and Pattern Recognition · Computer Science 2021-02-03 Hmrishav Bandyopadhyay , Tanmoy Dasgupta , Nibaran Das , Mita Nasipuri

It is shown that neural networks (NNs) achieve excellent performances in image compression and reconstruction. However, there are still many shortcomings in the practical application, which eventually lead to the loss of neural network…

Multimedia · Computer Science 2019-11-15 Zhiqing Lu , Zhaoxia Yin , Bin Luo