中文
相关论文

相关论文: Image Captioning as an Assistive Technology: Lesso…

200 篇论文

Automatically generating natural language descriptions from an image is a challenging problem in artificial intelligence that requires a good understanding of the visual and textual signals and the correlations between them. The…

计算与语言 · 计算机科学 2020-08-07 Arushi Goel , Basura Fernando , Thanh-Son Nguyen , Hakan Bilen

This research explores the realm of neural image captioning using deep learning models. The study investigates the performance of different neural architecture configurations, focusing on the inject architecture, and proposes a novel…

计算机视觉与模式识别 · 计算机科学 2023-12-04 Pooja Bhatnagar , Sai Mrunaal , Sachin Kamnure

The traditional image captioning task uses generic reference captions to provide textual information about images. Different user populations, however, will care about different visual aspects of images. In this paper, we propose a new…

计算与语言 · 计算机科学 2020-11-10 Adam Fisch , Kenton Lee , Ming-Wei Chang , Jonathan H. Clark , Regina Barzilay

Generating a description of an image is called image captioning. Image captioning requires to recognize the important objects, their attributes and their relationships in an image. It also needs to generate syntactically and semantically…

计算机视觉与模式识别 · 计算机科学 2018-10-16 Md. Zakir Hossain , Ferdous Sohel , Mohd Fairuz Shiratuddin , Hamid Laga

Automatically describing images using natural sentences is an important task to support visually impaired people's inclusion onto the Internet. It is still a big challenge that requires understanding the relation of the objects present in…

计算机视觉与模式识别 · 计算机科学 2026-04-21 Gabriel Oliveira dos Santos , Esther Luna Colombini , Sandra Avila

Automatically creating the description of an image using any natural languages sentence like English is a very challenging task. It requires expertise of both image processing as well as natural language processing. This paper discuss about…

计算机视觉与模式识别 · 计算机科学 2018-10-03 Parth Shah , Vishvajit Bakarola , Supriya Pati

Existing approaches to image captioning usually generate the sentence word-by-word from left to right, with the constraint of conditioned on local context including the given image and history generated words. There have been many studies…

计算机视觉与模式识别 · 计算机科学 2022-10-19 Zhengcong Fei , Junshi Huang , Xiaoming Wei , Xiaolin Wei

We examine the possibility that recent promising results in automatic caption generation are due primarily to language models. By varying image representation quality produced by a convolutional neural network, we find that a…

计算与语言 · 计算机科学 2015-08-11 Jack Hessel , Nicolas Savva , Michael J. Wilber

The aim of image captioning is to generate textual description of a given image. Though seemingly an easy task for humans, it is challenging for machines as it requires the ability to comprehend the image (computer vision) and consequently…

计算机视觉与模式识别 · 计算机科学 2020-11-12 Anubhav Shrimal , Tanmoy Chakraborty

Video captioning is the process of describing the content of a sequence of images capturing its semantic relationships and meanings. Dealing with this task with a single image is arduous, not to mention how difficult it is for a video (or…

计算机视觉与模式识别 · 计算机科学 2022-04-14 Daniela Moctezuma , Tania Ramírez-delReal , Guillermo Ruiz , Othón González-Chávez

Image captioning is a challenging problem owing to the complexity in understanding the image content and diverse ways of describing it in natural language. Recent advances in deep neural networks have substantially improved the performance…

计算机视觉与模式识别 · 计算机科学 2017-04-14 Zhou Ren , Xiaoyu Wang , Ning Zhang , Xutao Lv , Li-Jia Li

Automated image captioning has the potential to be a useful tool for people with vision impairments. Images taken by this user group are often noisy, which leads to incorrect and even unsafe model predictions. In this paper, we propose a…

计算机视觉与模式识别 · 计算机科学 2023-05-02 Lu Yu , Malvina Nikandrou , Jiali Jin , Verena Rieser

Image captioning is a task in the field of Artificial Intelligence that merges between computer vision and natural language processing. It is responsible for generating legends that describe images, and has various applications like…

计算机视觉与模式识别 · 计算机科学 2021-07-29 Ahmed Elhagry , Karima Kadaoui

Image captioning is an important task for benchmarking visual reasoning and for enabling accessibility for people with vision impairments. However, as in many machine learning settings, social biases can influence image captioning in…

计算机视觉与模式识别 · 计算机科学 2021-08-31 Dora Zhao , Angelina Wang , Olga Russakovsky

We present an image caption system that addresses new challenges of automatically describing images in the wild. The challenges include high quality caption quality with respect to human judgments, out-of-domain data handling, and low…

计算机视觉与模式识别 · 计算机科学 2016-04-01 Kenneth Tran , Xiaodong He , Lei Zhang , Jian Sun , Cornelia Carapcea , Chris Thrasher , Chris Buehler , Chris Sienkiewicz

In recent years, the biggest advances in major Computer Vision tasks, such as object recognition, handwritten-digit identification, facial recognition, and many others., have all come through the use of Convolutional Neural Networks (CNNs).…

计算与语言 · 计算机科学 2019-07-05 Elaina Tan , Lakshay Sharma

Image captioning is the process of automatically generating a description of an image in natural language. Image captioning is one of the significant challenges in image understanding since it requires not only recognizing salient objects…

计算机视觉与模式识别 · 计算机科学 2022-07-26 Ghadah Alabduljabbar , Hafida Benhidour , Said Kerrache

Data visualization captions help readers understand the purpose of a visualization and are crucial for individuals with visual impairments. The prevalence of poor figure captions and the successful application of deep learning approaches to…

计算机视觉与模式识别 · 计算机科学 2022-07-18 Anita Mahinpei , Zona Kostic , Chris Tanner

Image captioning strives to generate pertinent captions for specified images, situating itself at the crossroads of Computer Vision (CV) and Natural Language Processing (NLP). This endeavor is of paramount importance with far-reaching…

计算机视觉与模式识别 · 计算机科学 2024-04-03 Tianrui Liu , Qi Cai , Changxin Xu , Bo Hong , Jize Xiong , Yuxin Qiao , Tsungwei Yang

The aim of image captioning is to generate captions by machine to describe image contents. Despite many efforts, generating discriminative captions for images remains non-trivial. Most traditional approaches imitate the language structure…

计算机视觉与模式识别 · 计算机科学 2018-07-24 Xihui Liu , Hongsheng Li , Jing Shao , Dapeng Chen , Xiaogang Wang