中文
相关论文

相关论文: Summaries as Captions: Generating Figure Captions …

200 篇论文

Automatically generating natural language descriptions from an image is a challenging problem in artificial intelligence that requires a good understanding of the visual and textual signals and the correlations between them. The…

计算与语言 · 计算机科学 2020-08-07 Arushi Goel , Basura Fernando , Thanh-Son Nguyen , Hakan Bilen

Automatic image captioning is a promising technique for conveying visual information using natural language. It can benefit various tasks in satellite remote sensing, such as environmental monitoring, resource management, disaster…

计算机视觉与模式识别 · 计算机科学 2023-10-18 Yingxu He , Qiqi Sun

We propose a summarization approach for scientific articles which takes advantage of citation-context and the document discourse model. While citations have been previously used in generating scientific summaries, they lack the related…

计算与语言 · 计算机科学 2017-04-24 Arman Cohan , Nazli Goharian

Image descriptions can help visually impaired people to quickly understand the image content. While we made significant progress in automatically describing images and optical character recognition, current approaches are unable to include…

计算机视觉与模式识别 · 计算机科学 2020-08-05 Oleksii Sidorov , Ronghang Hu , Marcus Rohrbach , Amanpreet Singh

Automatically generating a human-like description for a given image is a potential research in artificial intelligence, which has attracted a great of attention recently. Most of the existing attention methods explore the mapping…

计算机视觉与模式识别 · 计算机科学 2020-11-03 Feicheng Huang , Zhixin Li , Haiyang Wei , Canlong Zhang , Huifang Ma

Previous work for text summarization in scientific domain mainly focused on the content of the input document, but seldom considering its citation network. However, scientific papers are full of uncommon domain-specific terms, making it…

计算与语言 · 计算机科学 2021-04-08 Chenxin An , Ming Zhong , Yiran Chen , Danqing Wang , Xipeng Qiu , Xuanjing Huang

Captions are crucial for understanding scientific visualizations and documents. Existing captioning methods for scientific figures rely on figure-caption pairs extracted from documents for training, many of which fall short with respect to…

Observing a set of images and their corresponding paragraph-captions, a challenging task is to learn how to produce a semantically coherent paragraph to describe the visual content of an image. Inspired by recent successes in integrating…

计算机视觉与模式识别 · 计算机科学 2022-07-27 Dandan Guo , Ruiying Lu , Bo Chen , Zequn Zeng , Mingyuan Zhou

Automatic summarisation is a popular approach to reduce a document to its main arguments. Recent research in the area has focused on neural approaches to summarisation, which can be very data-hungry. However, few large datasets exist and…

计算与语言 · 计算机科学 2017-06-14 Ed Collins , Isabelle Augenstein , Sebastian Riedel

Figures, such as bar charts, pie charts, and line plots, are widely used to convey important information in a concise format. They are usually human-friendly but difficult for computers to process automatically. In this work, we investigate…

计算机视觉与模式识别 · 计算机科学 2019-06-10 Charles Chen , Ruiyi Zhang , Eunyee Koh , Sungchul Kim , Scott Cohen , Tong Yu , Ryan Rossi , Razvan Bunescu

Accurately reporting what objects are depicted in an image is largely a solved problem in automatic caption generation. The next big challenge on the way to truly humanlike captioning is being able to incorporate the context of the image…

计算与语言 · 计算机科学 2022-10-11 Sofia Nikiforova , Tejaswini Deoskar , Denis Paperno , Yoad Winter

Image captioning, which generates natural language descriptions of the visual information in an image, is a crucial task in vision-language research. Previous models have typically addressed this task by aligning the generative capabilities…

计算机视觉与模式识别 · 计算机科学 2024-09-02 Qian Cao , Xu Chen , Ruihua Song , Xiting Wang , Xinting Huang , Yuchen Ren

Automatic image captioning has improved significantly over the last few years, but the problem is far from being solved, with state of the art models still often producing low quality captions when used in the wild. In this paper, we focus…

计算与语言 · 计算机科学 2021-06-03 Tomer Levinboim , Ashish V. Thapliyal , Piyush Sharma , Radu Soricut

This paper discusses and demonstrates the outcomes from our experimentation on Image Captioning. Image captioning is a much more involved task than image recognition or classification, because of the additional challenge of recognizing the…

计算机视觉与模式识别 · 计算机科学 2018-05-24 Vikram Mullachery , Vishal Motwani

Image Captioning is a task that requires models to acquire a multi-modal understanding of the world and to express this understanding in natural language text. While the state-of-the-art for this task has rapidly improved in terms of n-gram…

计算机视觉与模式识别 · 计算机科学 2018-12-20 Annika Lindh , Robert J. Ross , Abhijit Mahalunkar , Giancarlo Salton , John D. Kelleher

Scientific figure captions require both accuracy and stylistic consistency to convey visual information. Here, we present a domain-specific caption generation system for the 3rd SciCap Challenge that integrates figure-related textual…

计算与语言 · 计算机科学 2025-10-10 Watcharapong Timklaypachara , Monrada Chiewhawan , Nopporn Lekuthai , Titipat Achakulvisut

Image captioning, a fundamental task in vision-language understanding, seeks to generate accurate natural language descriptions for provided images. Current image captioning approaches heavily rely on high-quality image-caption pairs, which…

计算机视觉与模式识别 · 计算机科学 2023-11-03 Chuanyang Jin

Recent progress on image captioning has made it possible to generate novel sentences describing images in natural language, but compressing an image into a single sentence can describe visual content in only coarse detail. While one new…

计算机视觉与模式识别 · 计算机科学 2017-04-11 Jonathan Krause , Justin Johnson , Ranjay Krishna , Li Fei-Fei

This paper addresses the task of generating fluent descriptions by training on a non-uniform combination of data sources, containing both human-annotated and web-collected captions. Large-scale datasets with noisy image-text pairs, indeed,…

计算机视觉与模式识别 · 计算机科学 2023-12-01 Marcella Cornia , Lorenzo Baraldi , Giuseppe Fiameni , Rita Cucchiara

Recent advances in image captioning task have led to increasing interests in video captioning task. However, most works on video captioning are focused on generating single input of aggregated features, which hardly deviates from image…

计算机视觉与模式识别 · 计算机科学 2016-05-19 Andrew Shin , Katsunori Ohnishi , Tatsuya Harada