English
Related papers

Related papers: Compressed Image Captioning using CNN-based Encode…

200 papers

Convolutional Neural Networks (CNNs) have gained a remarkable success on many image classification tasks in recent years. However, the performance of CNNs highly relies upon their architectures. For most state-of-the-art CNNs, their…

Neural and Evolutionary Computing · Computer Science 2020-03-30 Yanan Sun , Bing Xue , Mengjie Zhang , Gary G. Yen

We hypothesize that end-to-end neural image captioning systems work seemingly well because they exploit and learn `distributional similarity' in a multimodal feature space by mapping a test image to similar training images in this space and…

Computer Vision and Pattern Recognition · Computer Science 2018-09-13 Pranava Madhyastha , Josiah Wang , Lucia Specia

Multi-modal approaches employ data from multiple input streams such as textual and visual domains. Deep neural networks have been successfully employed for these approaches. In this paper, we present a novel multi-modal approach that fuses…

Computer Vision and Pattern Recognition · Computer Science 2018-10-05 Ignazio Gallo , Alessandro Calefati , Shah Nawaz , Muhammad Kamran Janjua

In recent decades, digital image processing has gained enormous popularity. Consequently, a number of data compression strategies have been put forth, with the goal of minimizing the amount of information required to represent images. Among…

Image and Video Processing · Electrical Eng. & Systems 2023-07-04 Suman Kunwar

In the Bag-of-Words (BoW) model based image retrieval task, the precision of visual matching plays a critical role in improving retrieval performance. Conventionally, local cues of a keypoint are employed. However, such strategy does not…

Computer Vision and Pattern Recognition · Computer Science 2014-06-03 Liang Zheng , Shengjin Wang , Fei He , Qi Tian

The encode-decoder framework has shown recent success in image captioning. Visual attention, which is good at detailedness, and semantic attention, which is good at comprehensiveness, have been separately proposed to ground the caption on…

Computation and Language · Computer Science 2018-08-28 Fenglin Liu , Xuancheng Ren , Yuanxin Liu , Houfeng Wang , Xu Sun

Video Captioning (VC) is a challenging multi-modal task since it requires describing the scene in language by understanding various and complex videos. For machines, the traditional VC follows the…

Computer Vision and Pattern Recognition · Computer Science 2024-01-11 Jianqiao Sun , Yudi Su , Hao Zhang , Ziheng Cheng , Zequn Zeng , Zhengjue Wang , Bo Chen , Xin Yuan

We do not speak word by word from scratch; our brain quickly structures a pattern like \textsc{sth do sth at someplace} and then fill in the detailed descriptions. To render existing encoder-decoder image captioners such human-like…

Computer Vision and Pattern Recognition · Computer Science 2019-04-19 Xu Yang , Hanwang Zhang , Jianfei Cai

Image captioning has been recently gaining a lot of attention thanks to the impressive achievements shown by deep captioning architectures, which combine Convolutional Neural Networks to extract image representations, and Recurrent Neural…

Computer Vision and Pattern Recognition · Computer Science 2018-05-22 Marcella Cornia , Lorenzo Baraldi , Giuseppe Serra , Rita Cucchiara

Deep Convolutional Neural Networks (CNN) have exhibited superior performance in many visual recognition tasks including image classification, object detection, and scene label- ing, due to their large learning capacity and resistance to…

Computer Vision and Pattern Recognition · Computer Science 2016-10-12 Miao Sun , Tony X. Han , Xun Xu , Ming-Chang Liu , Ahmad Khodayari-Rostamabad

It has recently been demonstrated that spatial resolution adaptation can be integrated within video compression to improve overall coding performance by spatially down-sampling before encoding and super-resolving at the decoder. Significant…

Image and Video Processing · Electrical Eng. & Systems 2021-01-21 Di Ma , Fan Zhang , David R. Bull

Image captioning is a challenging computer vision task, which aims to generate a natural language description of an image. Most recent researches follow the encoder-decoder framework which depends heavily on the previous generated words for…

Computer Vision and Pattern Recognition · Computer Science 2021-01-05 Zeliang Song , Xiaofei Zhou , Zhendong Mao , Jianlong Tan

One of the ways blind people understand their surroundings is by clicking images and relying on descriptions generated by image captioning systems. Current work on captioning images for the visually impaired do not use the textual data…

Computation and Language · Computer Science 2021-05-19 Hiba Ahsan , Nikita Bhalla , Daivat Bhatt , Kaivankumar Shah

Compression is a standard procedure for making convolutional neural networks (CNNs) adhere to some specific computing resource constraints. However, searching for a compressed architecture typically involves a series of time-consuming…

Image and Video Processing · Electrical Eng. & Systems 2021-07-08 Suraj Mishra , Danny Z. Chen , X. Sharon Hu

Explaining the prediction of deep neural networks (DNNs) and semantic image compression are two active research areas of deep learning with a numerous of applications in decision-critical systems, such as surveillance cameras, drones and…

Computer Vision and Pattern Recognition · Computer Science 2020-12-09 Xiang Li , Shihao Ji

With the advancement of remote-sensed imaging large volumes of very high resolution land cover images can now be obtained. Automation of object recognition in these 2D images, however, is still a key issue. High intra-class variance and low…

Computer Vision and Pattern Recognition · Computer Science 2019-10-15 Vikas Agaradahalli Gurumurthy

Image captioning involves generating textual descriptions from input images, bridging the gap between computer vision and natural language processing. Recent advancements in transformer-based models have significantly improved caption…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Israa A. Albadarneh , Bassam H. Hammo , Omar S. Al-Kadi

Image captioning, a challenging task where the machine automatically describes an image by sentences, has drawn significant attention in recent years. Despite the remarkable improvements of recent approaches, however, these methods are…

Multimedia · Computer Science 2020-01-14 Qianyu Feng , Yu Wu , Hehe Fan , Chenggang Yan , Yi Yang

Purpose: The aim of this work is to demonstrate that convolutional neural networks (CNN) can be applied to extremely sparse image libraries by subdivision of the original image datasets. Methods: Image datasets from a conventional digital…

Computer Vision and Pattern Recognition · Computer Science 2020-10-27 Johan P. Boetker

Recently, generative adversarial networks have gained a lot of popularity for image generation tasks. However, such models are associated with complex learning mechanisms and demand very large relevant datasets. This work borrows concepts…

Machine Learning · Computer Science 2018-09-28 Shagan Sah , Chi Zhang , Thang Nguyen , Dheeraj Kumar Peri , Ameya Shringi , Raymond Ptucha