中文
相关论文

相关论文: Language-Driven Region Pointer Advancement for Con…

200 篇论文

Image captioning has been recently gaining a lot of attention thanks to the impressive achievements shown by deep captioning architectures, which combine Convolutional Neural Networks to extract image representations, and Recurrent Neural…

计算机视觉与模式识别 · 计算机科学 2018-05-22 Marcella Cornia , Lorenzo Baraldi , Giuseppe Serra , Rita Cucchiara

In today's world, image processing plays a crucial role across various fields, from scientific research to industrial applications. But one particularly exciting application is image captioning. The potential impact of effective image…

计算机视觉与模式识别 · 计算机科学 2024-04-30 Md Alif Rahman Ridoy , M Mahmud Hasan , Shovon Bhowmick

Automatically generating the descriptions of an image, i.e., image captioning, is an important and fundamental topic in artificial intelligence, which bridges the gap between computer vision and natural language processing. Based on the…

计算机视觉与模式识别 · 计算机科学 2019-01-14 Shiyang Yan , Yuan Xie , Fangyu Wu , Jeremy S. Smith , Wenjin Lu , Bailing Zhang

The aim of image captioning is to generate textual description of a given image. Though seemingly an easy task for humans, it is challenging for machines as it requires the ability to comprehend the image (computer vision) and consequently…

计算机视觉与模式识别 · 计算机科学 2020-11-12 Anubhav Shrimal , Tanmoy Chakraborty

The Controllable Image Captioning Agent (CapAgent) is an innovative system designed to bridge the gap between user simplicity and professional-level outputs in image captioning tasks. CapAgent automatically transforms user-provided simple…

计算机视觉与模式识别 · 计算机科学 2025-01-13 Xinran Wang , Muxi Diao , Baoteng Li , Haiwen Zhang , Kongming Liang , Zhanyu Ma

Image captioning is a fundamental task in vision-language understanding, where the model predicts a textual informative caption to a given input image. In this paper, we present a simple approach to address this task. We use CLIP encoding…

计算机视觉与模式识别 · 计算机科学 2021-11-19 Ron Mokady , Amir Hertz , Amit H. Bermano

Inspired by recent work in machine translation and object detection, we introduce an attention based model that automatically learns to describe the content of images. We describe how we can train this model in a deterministic manner using…

Image captioning is a longstanding problem in the field of computer vision and natural language processing. To date, researchers have produced impressive state-of-the-art performance in the age of deep learning. Most of these…

计算机视觉与模式识别 · 计算机科学 2022-07-20 Zihang Meng , David Yang , Xuefei Cao , Ashish Shah , Ser-Nam Lim

Image captioning has received significant attention with remarkable improvements in recent advances. Nevertheless, images in the wild encapsulate rich knowledge and cannot be sufficiently described with models built on image-caption pairs…

计算机视觉与模式识别 · 计算机科学 2019-04-26 Yehao Li , Ting Yao , Yingwei Pan , Hongyang Chao , Tao Mei

Image captioning has been shown as an effective pretraining method similar to contrastive pretraining. However, the incorporation of location-aware information into visual pretraining remains an area with limited research. In this paper, we…

计算机视觉与模式识别 · 计算机科学 2024-11-13 Bo Wan , Michael Tschannen , Yongqin Xian , Filip Pavetic , Ibrahim Alabdulmohsin , Xiao Wang , André Susano Pinto , Andreas Steiner , Lucas Beyer , Xiaohua Zhai

In the era of evolving artificial intelligence, machines are increasingly emulating human-like capabilities, including visual perception and linguistic expression. Image captioning stands at the intersection of these domains, enabling…

计算机视觉与模式识别 · 计算机科学 2024-08-29 Hrishikesh Singh , Aarti Sharma , Millie Pant

Automatically generating descriptive captions for images is a well-researched area in computer vision. However, existing evaluation approaches focus on measuring the similarity between two sentences disregarding fine-grained semantics of…

计算机视觉与模式识别 · 计算机科学 2019-08-07 Philipp Harzig , Dan Zecha , Rainer Lienhart , Carolin Kaiser , René Schallner

Spatially dense self-supervised learning is a rapidly growing problem domain with promising applications for unsupervised segmentation and pretraining for dense downstream tasks. Despite the abundance of temporal data in the form of videos,…

计算机视觉与模式识别 · 计算机科学 2023-08-24 Mohammadreza Salehi , Efstratios Gavves , Cees G. M. Snoek , Yuki M. Asano

We examine the possibility that recent promising results in automatic caption generation are due primarily to language models. By varying image representation quality produced by a convolutional neural network, we find that a…

计算与语言 · 计算机科学 2015-08-11 Jack Hessel , Nicolas Savva , Michael J. Wilber

Image captioning has long been regarded as a fundamental task in visual understanding. Recently, however, few large vision-language model (LVLM) research discusses model's image captioning performance because of the outdated short-caption…

计算机视觉与模式识别 · 计算机科学 2024-07-09 Hongyuan Dong , Jiawen Li , Bohong Wu , Jiacong Wang , Yuan Zhang , Haoyuan Guo

Image Captioning, or the automatic generation of descriptions for images, is one of the core problems in Computer Vision and has seen considerable progress using Deep Learning Techniques. We propose to use Inception-ResNet Convolutional…

计算机视觉与模式识别 · 计算机科学 2021-02-23 Sulabh Katiyar , Samir Kumar Borgohain

Image captioning is an important but challenging task, applicable to virtual assistants, editing tools, image indexing, and support of the disabled. Its challenges are due to the variability and ambiguity of possible image descriptions. In…

计算机视觉与模式识别 · 计算机科学 2017-11-28 Jyoti Aneja , Aditya Deshpande , Alexander Schwing

Image Captioning (IC) models can highly benefit from human feedback in the training process, especially in cases where data is limited. We present work-in-progress on adapting an IC system to integrate human feedback, with the goal to make…

计算与语言 · 计算机科学 2023-06-07 Aliki Anagnostopoulou , Mareike Hartmann , Daniel Sonntag

Large language models have achieved great success in recent years, so as their variants in vision. Existing vision-language models can describe images in natural languages, answer visual-related questions, or perform complex reasoning about…

计算机视觉与模式识别 · 计算机科学 2023-12-15 Jiarui Xu , Xingyi Zhou , Shen Yan , Xiuye Gu , Anurag Arnab , Chen Sun , Xiaolong Wang , Cordelia Schmid

Automated captioning of photos is a mission that incorporates the difficulties of photo analysis and text generation. One essential feature of captioning is the concept of attention: how to determine what to specify and in which sequence.…

计算机视觉与模式识别 · 计算机科学 2020-12-18 Daniel Yarnell , Xian Wang