中文
相关论文

相关论文: Modeling Image-Caption Rating from Comparative Jud…

200 篇论文

Automatically creating the description of an image using any natural languages sentence like English is a very challenging task. It requires expertise of both image processing as well as natural language processing. This paper discuss about…

计算机视觉与模式识别 · 计算机科学 2018-10-03 Parth Shah , Vishvajit Bakarola , Supriya Pati

Image captioning remains a fundamental task for vision language understanding, yet ground-truth supervision still relies predominantly on human-annotated references. Because human annotations reflect subjective preferences and expertise,…

计算机视觉与模式识别 · 计算机科学 2026-03-31 Zhijiang Tang , Linhua Wang , Jiaxin Qi , Weihao Jiang , Peng Hou , Anxiang Zeng , Jianqiang Huang

Image captioning is a challenging task at the intersection of computer vision and natural language processing, requiring models to generate meaningful textual descriptions of images. Traditional approaches rely on recurrent neural networks…

计算机视觉与模式识别 · 计算机科学 2025-02-27 Hemanth Teja Yanambakkam , Rahul Chinthala

The aim of image captioning is to generate captions by machine to describe image contents. Despite many efforts, generating discriminative captions for images remains non-trivial. Most traditional approaches imitate the language structure…

计算机视觉与模式识别 · 计算机科学 2018-07-24 Xihui Liu , Hongsheng Li , Jing Shao , Dapeng Chen , Xiaogang Wang

Describing images in natural language is a fundamental step towards the automatic modeling of connections between the visual and textual modalities. In this paper we present CaMEL, a novel Transformer-based architecture for image…

计算机视觉与模式识别 · 计算机科学 2022-02-23 Manuele Barraco , Matteo Stefanini , Marcella Cornia , Silvia Cascianelli , Lorenzo Baraldi , Rita Cucchiara

In this paper, we propose a novel conditional-generative-adversarial-nets-based image captioning framework as an extension of traditional reinforcement-learning (RL)-based encoder-decoder architecture. To deal with the inconsistent…

计算机视觉与模式识别 · 计算机科学 2020-09-10 Chen Chen , Shuai Mu , Wanpeng Xiao , Zexiong Ye , Liesi Wu , Qi Ju

Model-based evaluation metrics (e.g., CLIPScore and GPTScore) have demonstrated decent correlations with human judgments in various language generation tasks. However, their impact on fairness remains largely unexplored. It is widely…

计算与语言 · 计算机科学 2023-11-06 Haoyi Qiu , Zi-Yi Dou , Tianlu Wang , Asli Celikyilmaz , Nanyun Peng

Generating a novel textual description of an image is an interesting problem that connects computer vision and natural language processing. In this paper, we present a simple model that is able to generate descriptive sentences given a…

计算与语言 · 计算机科学 2015-04-10 Rémi Lebret , Pedro O. Pinheiro , Ronan Collobert

Image captioning is a longstanding problem in the field of computer vision and natural language processing. To date, researchers have produced impressive state-of-the-art performance in the age of deep learning. Most of these…

计算机视觉与模式识别 · 计算机科学 2022-07-20 Zihang Meng , David Yang , Xuefei Cao , Ashish Shah , Ser-Nam Lim

Recent image captioning models are achieving impressive results based on popular metrics, i.e., BLEU, CIDEr, and SPICE. However, focusing on the most popular metrics that only consider the overlap between the generated captions and human…

计算机视觉与模式识别 · 计算机科学 2022-04-11 Jiuniu Wang , Wenjia Xu , Qingzhong Wang , Antoni B. Chan

A wide range of image captioning models has been developed, achieving significant improvement based on popular metrics, such as BLEU, CIDEr, and SPICE. However, although the generated captions can accurately describe the image, they are…

计算机视觉与模式识别 · 计算机科学 2020-09-30 Jiuniu Wang , Wenjia Xu , Qingzhong Wang , Antoni B. Chan

Despite the substantial progress in recent years, the image captioning techniques are still far from being perfect.Sentences produced by existing methods, e.g. those based on RNNs, are often overly rigid and lacking in variability. This…

计算机视觉与模式识别 · 计算机科学 2017-08-14 Bo Dai , Sanja Fidler , Raquel Urtasun , Dahua Lin

Benefiting from advances in machine vision and natural language processing techniques, current image captioning systems are able to generate detailed visual descriptions. For the most part, these descriptions represent an objective…

计算机视觉与模式识别 · 计算机科学 2020-04-16 Omid Mohamad Nezami , Mark Dras , Stephen Wan , Cecile Paris

Image captioning models tend to describe images in an object-centric way, emphasising visible objects. But image descriptions can also abstract away from objects and describe the type of scene depicted. In this paper, we explore the…

计算与语言 · 计算机科学 2022-11-11 Michele Cafagna , Kees van Deemter , Albert Gatt

Computational visual aesthetics has recently become an active research area. Existing state-of-art methods formulate this as a binary classification task where a given image is predicted to be beautiful or not. In many applications such as…

计算机视觉与模式识别 · 计算机科学 2017-04-06 Parag S. Chandakkar , Vijetha Gattupalli , Baoxin Li

Automatically captioning images with natural language sentences is an important research topic. State of the art models are able to produce human-like sentences. These models typically describe the depicted scene as a whole and do not…

计算机视觉与模式识别 · 计算机科学 2019-08-07 Philipp Harzig , Stephan Brehm , Rainer Lienhart , Carolin Kaiser , René Schallner

Image captioning is a challenging computer vision task, which aims to generate a natural language description of an image. Most recent researches follow the encoder-decoder framework which depends heavily on the previous generated words for…

计算机视觉与模式识别 · 计算机科学 2021-01-05 Zeliang Song , Xiaofei Zhou , Zhendong Mao , Jianlong Tan

Constructing an organized dataset comprised of a large number of images and several captions for each image is a laborious task, which requires vast human effort. On the other hand, collecting a large number of images and sentences…

计算机视觉与模式识别 · 计算机科学 2019-11-22 Dong-Jin Kim , Jinsoo Choi , Tae-Hyun Oh , In So Kweon

The use of attention models for automated image captioning has enabled many systems to produce accurate and meaningful descriptions for images. Over the years, many novel approaches have been proposed to enhance the attention process using…

计算机视觉与模式识别 · 计算机科学 2022-04-18 Murad Popattia , Muhammad Rafi , Rizwan Qureshi , Shah Nawaz

The task of image captioning aims to generate captions directly from images via the automatically learned cross-modal generator. To build a well-performing generator, existing approaches usually need a large number of described images,…

计算机视觉与模式识别 · 计算机科学 2021-10-29 Yang Yang , Hongchen Wei , Hengshu Zhu , Dianhai Yu , Hui Xiong , Jian Yang