中文
相关论文

相关论文: Captioning Images with Diverse Objects

200 篇论文

Image captioning is an interdisciplinary research problem that stands between computer vision and natural language processing. The task is to generate a textual description of the content of an image. The typical model used for image…

计算机视觉与模式识别 · 计算机科学 2018-10-16 Loris Bazzani , Tobias Domhan , Felix Hieber

Image captioning is a challenging problem owing to the complexity in understanding the image content and diverse ways of describing it in natural language. Recent advances in deep neural networks have substantially improved the performance…

计算机视觉与模式识别 · 计算机科学 2017-04-14 Zhou Ren , Xiaoyu Wang , Ning Zhang , Xutao Lv , Li-Jia Li

Image captioning is the process of automatically generating a description of an image in natural language. Image captioning is one of the significant challenges in image understanding since it requires not only recognizing salient objects…

计算机视觉与模式识别 · 计算机科学 2022-07-26 Ghadah Alabduljabbar , Hafida Benhidour , Said Kerrache

Object recognition has become a crucial part of machine learning and computer vision recently. The current approach to object recognition involves Deep Learning and uses Convolutional Neural Networks to learn the pixel patterns of the…

计算机视觉与模式识别 · 计算机科学 2017-08-29 Abrar Ahmed , Anish Bikmal

News Image Captioning aims to create captions from news articles and images, emphasizing the connection between textual context and visual elements. Recognizing the significance of human faces in news images and the face-name co-occurrence…

计算机视觉与模式识别 · 计算机科学 2024-03-22 Tingyu Qu , Tinne Tuytelaars , Marie-Francine Moens

Generating images with conditional descriptions gains increasing interests in recent years. However, existing conditional inputs are suffering from either unstructured forms (captions) or limited information and expensive labeling (scene…

计算机视觉与模式识别 · 计算机科学 2021-06-08 Tao Ma , Yikang Li

While current visual captioning models have achieved impressive performance, they often assume that the image is well-captured and provides a complete view of the scene. In real-world scenarios, however, a single image may not offer a good…

计算机视觉与模式识别 · 计算机科学 2023-08-22 Anwen Hu , Shizhe Chen , Liang Zhang , Qin Jin

Image captioning implies automatically generating textual descriptions of images based only on the visual input. Although this has been an extensively addressed research topic in recent years, not many contributions have been made in the…

计算机视觉与模式识别 · 计算机科学 2021-02-09 Eva Cetinic

Image captioning is a computer vision task that involves generating natural language descriptions for images. This method has numerous applications in various domains, including image retrieval systems, medicine, and various industries.…

计算机视觉与模式识别 · 计算机科学 2023-08-08 Sai Suprabhanu Nallapaneni , Subrahmanyam Konakanchi

It is always well believed that modeling relationships between objects would be helpful for representing and eventually describing an image. Nevertheless, there has not been evidence in support of the idea on image description generation.…

计算机视觉与模式识别 · 计算机科学 2018-09-20 Ting Yao , Yingwei Pan , Yehao Li , Tao Mei

Video captioning is a challenging task that requires a deep understanding of visual scenes. State-of-the-art methods generate captions using either scene-level or object-level information but without explicitly modeling object interactions.…

计算机视觉与模式识别 · 计算机科学 2020-04-01 Boxiao Pan , Haoye Cai , De-An Huang , Kuan-Hui Lee , Adrien Gaidon , Ehsan Adeli , Juan Carlos Niebles

Image captioning systems have recently improved dramatically, but they still tend to produce captions that are insensitive to the communicative goals that captions should meet. To address this, we propose Issue-Sensitive Image Captioning…

计算与语言 · 计算机科学 2020-10-07 Allen Nie , Reuben Cohn-Gordon , Christopher Potts

Humans exploit prior knowledge to describe images, and are able to adapt their explanation to specific contextual information, even to the extent of inventing plausible explanations when contextual information and images do not match. In…

计算机视觉与模式识别 · 计算机科学 2022-09-22 Khanh Nguyen , Ali Furkan Biten , Andres Mafla , Lluis Gomez , Dimosthenis Karatzas

Existing approaches to image captioning usually generate the sentence word-by-word from left to right, with the constraint of conditioned on local context including the given image and history generated words. There have been many studies…

计算机视觉与模式识别 · 计算机科学 2022-10-19 Zhengcong Fei , Junshi Huang , Xiaoming Wei , Xiaolin Wei

Despite great progress in object detection, most existing methods work only on a limited set of object categories, due to the tremendous human effort needed for bounding-box annotations of training data. To alleviate the problem, recent…

计算机视觉与模式识别 · 计算机科学 2022-07-14 Mingfei Gao , Chen Xing , Juan Carlos Niebles , Junnan Li , Ran Xu , Wenhao Liu , Caiming Xiong

Open-world detection poses significant challenges, as it requires the detection of any object using either object class labels or free-form texts. Existing related works often use large-scale manual annotated caption datasets for training,…

计算机视觉与模式识别 · 计算机科学 2024-04-09 Fanjie Kong , Yanbei Chen , Jiarui Cai , Davide Modolo

Recently, Deep Learning (DL) methods have shown an excellent performance in image captioning and visual question answering. However, despite their performance, DL methods do not learn the semantics of the words that are being used to…

计算机视觉与模式识别 · 计算机科学 2020-10-05 Leonardo Anjoletto Ferreira , Douglas De Rizzo Meneghetti , Paulo Eduardo Santos

Image descriptions can help visually impaired people to quickly understand the image content. While we made significant progress in automatically describing images and optical character recognition, current approaches are unable to include…

计算机视觉与模式识别 · 计算机科学 2020-08-05 Oleksii Sidorov , Ronghang Hu , Marcus Rohrbach , Amanpreet Singh

A more realistic object detection paradigm, Open-World Object Detection, has arisen increasing research interests in the community recently. A qualified open-world object detector can not only identify objects of known categories, but also…

计算机视觉与模式识别 · 计算机科学 2022-02-17 Shuo Yang , Peize Sun , Yi Jiang , Xiaobo Xia , Ruiheng Zhang , Zehuan Yuan , Changhu Wang , Ping Luo , Min Xu

Deep neural networks have achieved promising results in automatic image captioning due to their effective representation learning and context-based content generation capabilities. As a prominent type of deep features used in many of the…

计算机视觉与模式识别 · 计算机科学 2023-03-22 Ali Abedi , Hossein Karshenas , Peyman Adibi