中文
相关论文

相关论文: An Image captioning algorithm based on the Hybrid …

200 篇论文

Most RNN-based image captioning models receive supervision on the output words to mimic human captions. Therefore, the hidden states can only receive noisy gradient signals via layers of back-propagation through time, leading to less…

计算机视觉与模式识别 · 计算机科学 2020-01-16 Jialin Wu , Raymond J. Mooney

Connectionist temporal classification (CTC) is a popular sequence prediction approach for automatic speech recognition that is typically used with models based on recurrent neural networks (RNNs). We explore whether deep convolutional…

计算与语言 · 计算机科学 2018-02-16 Kalpesh Krishna , Liang Lu , Kevin Gimpel , Karen Livescu

Much recent progress in Vision-to-Language problems has been achieved through a combination of Convolutional Neural Networks (CNNs) and Recurrent Neural Networks (RNNs). This approach does not explicitly represent high-level semantic…

计算机视觉与模式识别 · 计算机科学 2016-12-19 Qi Wu , Chunhua Shen , Anton van den Hengel , Peng Wang , Anthony Dick

We introduce a generative smoothness regularization on manifolds (SToRM) model for the recovery of dynamic image data from highly undersampled measurements. The model assumes that the images in the dataset are non-linear mappings of…

图像与视频处理 · 电气工程与系统科学 2021-03-12 Qing Zou , Abdul Haseeb Ahmed , Prashant Nagpal , Stanley Kruger , Mathews Jacob

In recent years, layered image compression is demonstrated to be a promising direction, which encodes a compact representation of the input image and apply an up-sampling network to reconstruct the image. To further improve the quality of…

图像与视频处理 · 电气工程与系统科学 2021-02-02 Trinh Man Hoang , Jinjia Zhou , Yibo Fan

For image classification problems, various neural network models are commonly used due to their success in yielding high accuracies. Convolutional Neural Network (CNN) is one of the most frequently used deep learning methods for image…

计算机视觉与模式识别 · 计算机科学 2022-03-22 Ilkay Sikdokur , Inci Baytas , Arda Yurdakul

Semantic segmentation requires per-pixel prediction for a given image. Typically, the output resolution of a segmentation network is severely reduced due to the downsampling operations in the CNN backbone. Most previous methods employ…

计算机视觉与模式识别 · 计算机科学 2021-08-02 Bowen Zhang , Yifan Liu , Zhi Tian , Chunhua Shen

Contemporary deep learning based video captioning follows encoder-decoder framework. In encoder, visual features are extracted with 2D/3D Convolutional Neural Networks (CNNs) and a transformed version of those features is passed to the…

计算机视觉与模式识别 · 计算机科学 2019-11-22 Nayyer Aafaq , Naveed Akhtar , Wei Liu , Ajmal Mian

Inspired by retrieval-augmented language generation and pretrained Vision and Language (V&L) encoders, we present a new approach to image captioning that generates sentences given the input image and a set of captions retrieved from a…

计算机视觉与模式识别 · 计算机科学 2023-02-17 Rita Ramos , Desmond Elliott , Bruno Martins

There is very little notable research on generating descriptions of the Bengali language. About 243 million people speak in Bengali, and it is the 7th most spoken language on the planet. The purpose of this research is to propose a CNN and…

计算机视觉与模式识别 · 计算机科学 2020-12-23 Al Momin Faruk , Hasan Al Faraby , Md. Muzahidul Azad , Md. Riduyan Fedous , Md. Kishor Morol

In this paper, the problem of describing visual contents of a video sequence with natural language is addressed. Unlike previous video captioning work mainly exploiting the cues of video contents to make a language description, we propose a…

计算机视觉与模式识别 · 计算机科学 2018-04-02 Bairui Wang , Lin Ma , Wei Zhang , Wei Liu

We present a transformer-based multimodal framework for generating clinically relevant captions for MRI scans. Our system combines a DEiT-Small vision transformer as an image encoder, MediCareBERT for caption embedding, and a custom…

图像与视频处理 · 电气工程与系统科学 2025-11-03 Yogesh Thakku Suresh , Vishwajeet Shivaji Hogale , Luca-Alexandru Zamfira , Anandavardhana Hegde

Background and Purpose: Convolutional neural network is widely used for image recognition in the medical area at nowadays. However, overall accuracy in predicting lung tumor is low and the processing time is high as the error occurred while…

图像与视频处理 · 电气工程与系统科学 2022-08-15 Bhoj Raj Pandit , Abeer Alsadoon , P. W. C. Prasad , Sarmad Al Aloussi , Tarik A. Rashid , Omar Hisham Alsadoon , Oday D. Jerew

We present a `CLAssifier-DECoder' architecture (\emph{ClaDec}) which facilitates the comprehension of the output of an arbitrary layer in a neural network (NN). It uses a decoder to transform the non-interpretable representation of the…

机器学习 · 计算机科学 2021-03-01 Johannes Schneider , Michalis Vlachos

The use of Recurrent Neural Networks for video captioning has recently gained a lot of attention, since they can be used both to encode the input video and to generate the corresponding description. In this paper, we present a recurrent…

计算机视觉与模式识别 · 计算机科学 2018-11-26 Lorenzo Baraldi , Costantino Grana , Rita Cucchiara

In this paper we propose a new approach for learning local descriptors for matching image patches. It has recently been demonstrated that descriptors based on convolutional neural networks (CNN) can significantly improve the matching…

计算机视觉与模式识别 · 计算机科学 2016-01-20 Vassileios Balntas , Edward Johns , Lilian Tang , Krystian Mikolajczyk

To classify images based on their content is one of the most studied topics in the field of computer vision. Nowadays, this problem can be addressed using modern techniques such as Convolutional Neural Networks (CNN), but over the years…

计算机视觉与模式识别 · 计算机科学 2021-05-12 Òscar Lorente , Ian Riera , Aditya Rana

In many modern computer application problems, the classification of image data plays an important role. Among many different supervised machine learning models, convolutional neural networks (CNNs) and linear discriminant analysis (LDA) as…

计算机视觉与模式识别 · 计算机科学 2024-11-01 Axel Klawonn , Martin Lanser , Janine Weber

Intrinsic image decomposition is the process of separating the reflectance and shading layers of an image, which is a challenging and underdetermined problem. In this paper, we propose to systematically address this problem using a deep…

计算机视觉与模式识别 · 计算机科学 2018-07-31 Sai Bi , Nima Khademi Kalantari , Ravi Ramamoorthi

Skull stripping is usually the first step for most brain analysisprocess in magnetic resonance images. A lot of deep learn-ing neural network based methods have been developed toachieve higher accuracy. Since the 3D deep learning…

图像与视频处理 · 电气工程与系统科学 2019-10-25 Zhen Liu , Borui Xiao , Yuemeng Li , Yong Fan