中文
相关论文

相关论文: An Empirical Study of Language CNN for Image Capti…

200 篇论文

Existing image captioning systems are dedicated to generating narrative captions for images, which are spatially detached from the image in presentation. However, texts can also be used as decorations on the image to highlight the key…

计算机视觉与模式识别 · 计算机科学 2022-04-28 Yiqi Gao , Xinglin Hou , Yuanmeng Zhang , Tiezheng Ge , Yuning Jiang , Peng Wang

RNNs and their variants have been widely adopted for image captioning. In RNNs, the production of a caption is driven by a sequence of latent states. Existing captioning models usually represent latent states as vectors, taking this…

计算机视觉与模式识别 · 计算机科学 2018-08-15 Bo Dai , Deming Ye , Dahua Lin

This paper presents a novel latent variable recurrent neural network architecture for jointly modeling sequences of words and (possibly latent) discourse relations between adjacent sentences. A recurrent neural network generates individual…

计算与语言 · 计算机科学 2016-04-06 Yangfeng Ji , Gholamreza Haffari , Jacob Eisenstein

The "CNN-RNN" design pattern is increasingly widely applied in a variety of image annotation tasks including multi-label classification and captioning. Existing models use the weakly semantic CNN hidden layer or its transform as the image…

计算机视觉与模式识别 · 计算机科学 2016-11-18 Feng Liu , Tao Xiang , Timothy M. Hospedales , Wankou Yang , Changyin Sun

Connectionist temporal classification (CTC) is a popular sequence prediction approach for automatic speech recognition that is typically used with models based on recurrent neural networks (RNNs). We explore whether deep convolutional…

计算与语言 · 计算机科学 2018-02-16 Kalpesh Krishna , Liang Lu , Kevin Gimpel , Karen Livescu

Modern Neural Networks are eminent in achieving state of the art performance on tasks under Computer Vision, Natural Language Processing and related verticals. However, they are notorious for their voracious memory and compute appetite…

计算机视觉与模式识别 · 计算机科学 2020-12-18 Harshit Rampal , Aman Mohanty

This paper evaluates the viability of using fixed language models for training text classification networks on low-end hardware. We combine language models with a CNN architecture and put together a comprehensive benchmark with 8 datasets…

计算与语言 · 计算机科学 2023-05-09 Fabian Ziegner , Janos Borst , Andreas Niekler , Martin Potthast

We report on a series of experiments with convolutional neural networks (CNN) trained on top of pre-trained word vectors for sentence-level classification tasks. We show that a simple CNN with little hyperparameter tuning and static vectors…

计算与语言 · 计算机科学 2014-09-04 Yoon Kim

Recent neural network models for image captioning usually employ an encoder-decoder architecture, where the decoder adopts a recursive sequence decoding way. However, such autoregressive decoding may result in sequential error accumulation…

计算机视觉与模式识别 · 计算机科学 2019-12-16 Zheng-cong Fei

Stories are essential for genealogy research since they can help build emotional connections with people. A lot of family stories are reserved in historical photos and albums. Recent development on image captioning models makes it feasible…

计算机视觉与模式识别 · 计算机科学 2019-03-07 Jiayun Li , Mohammad K. Ebrahimpour , Azadeh Moghtaderi , Yen-Yun Yu

Recent advances in linguistic steganalysis have successively applied CNN, RNN, GNN and other efficient deep models for detecting secret information in generative texts. These methods tend to seek stronger feature extractors to achieve…

计算与语言 · 计算机科学 2022-02-03 Biao Yi , Hanzhou Wu , Guorui Feng , Xinpeng Zhang

Image captioning often requires a large set of training image-sentence pairs. In practice, however, acquiring sufficient training pairs is always expensive, making the recent captioning models limited in their ability to describe objects…

计算机视觉与模式识别 · 计算机科学 2017-08-18 Ting Yao , Yingwei Pan , Yehao Li , Tao Mei

Automated image captioning is one of the applications of Deep Learning which involves fusion of work done in computer vision and natural language processing, and it is typically performed using Encoder-Decoder architectures. In this…

计算机视觉与模式识别 · 计算机科学 2021-05-25 Aditya Bhattacharya , Eshwar Shamanna Girishekar , Padmakar Anil Deshpande

State-of-the-art approaches for image captioning require supervised training data consisting of captions with paired image data. These methods are typically unable to use unsupervised data such as textual data with no corresponding images,…

计算机视觉与模式识别 · 计算机科学 2017-06-27 Wenhu Chen , Aurelien Lucchi , Thomas Hofmann

Sentiment analysis of online user generated content is important for many social media analytics tasks. Researchers have largely relied on textual sentiment analysis to develop systems to predict political elections, measure economic…

计算机视觉与模式识别 · 计算机科学 2015-09-22 Quanzeng You , Jiebo Luo , Hailin Jin , Jianchao Yang

Transformer-based pre-trained models have gained much advance in recent years, becoming one of the most important backbones in natural language processing. Recent work shows that the attention mechanism inside Transformer may not be…

计算与语言 · 计算机科学 2022-10-27 Yile Wang , Linyi Yang , Zhiyang Teng , Ming Zhou , Yue Zhang

Describing images in natural language is a fundamental step towards the automatic modeling of connections between the visual and textual modalities. In this paper we present CaMEL, a novel Transformer-based architecture for image…

计算机视觉与模式识别 · 计算机科学 2022-02-23 Manuele Barraco , Matteo Stefanini , Marcella Cornia , Silvia Cascianelli , Lorenzo Baraldi , Rita Cucchiara

Despite the fact that image captioning models have been able to generate impressive descriptions for a given image, challenges remain: (1) the controllability and diversity of existing models are still far from satisfactory; (2) models…

计算机视觉与模式识别 · 计算机科学 2021-01-21 Zhangzi Zhu , Tianlei Wang , Hong Qu

The goal in word spotting is to retrieve parts of document images which are relevant with respect to a certain user-defined query. The recent past has seen attribute-based Convolutional Neural Networks take over this field of research. As…

计算机视觉与模式识别 · 计算机科学 2024-03-13 Eugen Rusakov , Sebastian Sudholt , Fabian Wolf , Gernot A. Fink

Image captioning is a challenging task involving generating a textual description for an image using computer vision and natural language processing techniques. This paper proposes a deep neural framework for image caption generation using…

计算机视觉与模式识别 · 计算机科学 2023-10-12 Rashid Khan , Bingding Huang , Haseeb Hassan , Asim Zaman , Zhongfu Ye