English
Related papers

Related papers: Pre-gen metrics: Predicting caption quality metric…

200 papers

Understanding video content and generating caption with context is an important and challenging task. Unlike prior methods that typically attempt to generate generic video captions without context, our architecture contextualizes captioning…

Computer Vision and Pattern Recognition · Computer Science 2020-07-30 Philipp Rimle , Pelin Dogan , Markus Gross

Evaluating the quality of automatically generated image descriptions is challenging, requiring metrics that capture various aspects such as grammaticality, coverage, correctness, and truthfulness. While human evaluation offers valuable…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Jia-Hong Huang , Hongyi Zhu , Yixian Shen , Stevan Rudinac , Alessio M. Pacces , Evangelos Kanoulas

We focus on the automatic evaluation of image captions in both reference-based and reference-free settings. Existing metrics based on large language models (LLMs) favor their own generations; therefore, the neutrality is in question. Most…

Computer Vision and Pattern Recognition · Computer Science 2025-12-29 Shinnosuke Hirano , Yuiga Wada , Kazuki Matsuda , Seitaro Otsuki , Komei Sugiura

Vision-language models can assess visual context in an image and generate descriptive text. While the generated text may be accurate and syntactically correct, it is often overly general. To address this, recent work has used optical…

Computer Vision and Pattern Recognition · Computer Science 2022-07-12 Wes Robbins , Zanyar Zohourianshahzadi , Jugal Kalita

This research explores the realm of neural image captioning using deep learning models. The study investigates the performance of different neural architecture configurations, focusing on the inject architecture, and proposes a novel…

Computer Vision and Pattern Recognition · Computer Science 2023-12-04 Pooja Bhatnagar , Sai Mrunaal , Sachin Kamnure

Human ratings are currently the most accurate way to assess the quality of an image captioning model, yet most often the only used outcome of an expensive human rating evaluation is a few overall statistics over the evaluation dataset. In…

Computer Vision and Pattern Recognition · Computer Science 2019-11-25 Paul Hongsuck Seo , Piyush Sharma , Tomer Levinboim , Bohyung Han , Radu Soricut

We use coherence relations inspired by computational models of discourse to study the information needs and goals of image captioning. Using an annotation protocol specifically devised for capturing image--caption coherence relations, we…

Computation and Language · Computer Science 2022-11-30 Malihe Alikhani , Piyush Sharma , Shengjie Li , Radu Soricut , Matthew Stone

Automatic evaluation metrics capable of replacing human judgments are critical to allowing fast development of new methods. Thus, numerous research efforts have focused on crafting such metrics. In this work, we take a step back and analyze…

Computation and Language · Computer Science 2022-10-10 Pierre Colombo , Maxime Peyrard , Nathan Noiry , Robert West , Pablo Piantanida

Classifiers and generators have long been separated. We break down this separation and showcase that conventional neural network classifiers can generate high-quality images of a large number of categories, being comparable to the…

Computer Vision and Pattern Recognition · Computer Science 2022-12-12 Guangrun Wang , Philip H. S. Torr

The ability to predict the performance of a query before results are returned has been a longstanding challenge in Information Retrieval (IR) systems. Inspired by this task, we introduce, in this paper, a novel task called "Prompt…

Information Retrieval · Computer Science 2024-02-01 Nicolas Bizzozzero , Ihab Bendidi , Olivier Risser-Maroix

Bridging robot action sequences and their natural language captions is an important task to increase explainability of human assisting robots in their recently evolving field. In this paper, we propose a system for generating natural…

Computation and Language · Computer Science 2020-03-24 Koichiro Yoshino , Kohei Wakimoto , Yuta Nishimura , Satoshi Nakamura

A major challenge in the field of Text Generation is evaluation: Human evaluations are cost-intensive, and automated metrics often display considerable disagreement with human judgments. In this paper, we propose a statistical model of Text…

Computation and Language · Computer Science 2023-06-07 Jan Deriu , Pius von Däniken , Don Tuggener , Mark Cieliebak

High-quality image captions play a crucial role in improving the performance of cross-modal applications such as text-to-image generation, text-to-video generation, and text-image retrieval. To generate long-form, high-quality captions,…

Computer Vision and Pattern Recognition · Computer Science 2025-04-10 Ruotian Peng , Haiying He , Yake Wei , Yandong Wen , Di Hu

Recent text-to-image matching models apply contrastive learning to large corpora of uncurated pairs of images and sentences. While such models can provide a powerful score for matching and subsequent zero-shot tasks, they are not capable of…

Computer Vision and Pattern Recognition · Computer Science 2022-04-01 Yoad Tewel , Yoav Shalev , Idan Schwartz , Lior Wolf

Cross-lingual image captioning, with its ability to caption an unlabeled image in a target language other than English, is an emerging topic in the multimedia field. In order to save the precious human resource from re-writing reference…

Computer Vision and Pattern Recognition · Computer Science 2020-12-10 Aozhu Chen , Xinyi Huang , Hailan Lin , Xirong Li

This paper presents an investigation of the capabilities of Generative Pre-trained Transformers (GPTs) to auto-generate graphical process models from multi-modal (i.e., text- and image-based) inputs. More precisely, we first introduce a…

Software Engineering · Computer Science 2024-06-10 Marvin Voelter , Raheleh Hadian , Timotheus Kampik , Marius Breitmayer , Manfred Reichert

The impressive capacity shown by recent text-to-image diffusion models to generate high-quality pictures from textual input prompts has leveraged the debate about the very definition of art. Nonetheless, these models have been trained using…

Computation and Language · Computer Science 2022-10-20 Ricardo Kleinlein , Cristina Luna-Jiménez , Fernando Fernández-Martínez

Conditional image generation has paved the way for several breakthroughs in image editing, generating stock photos and 3-D object generation. This continues to be a significant area of interest with the rise of new state-of-the-art methods…

Computer Vision and Pattern Recognition · Computer Science 2022-05-10 Vedant Singh , Surgan Jandial , Ayush Chopra , Siddharth Ramesh , Balaji Krishnamurthy , Vineeth N. Balasubramanian

Image captioning has demonstrated models that are capable of generating plausible text given input images or videos. Further, recent work in image generation has shown significant improvements in image quality when text is used as a prior.…

Machine Learning · Computer Science 2018-09-28 Shagan Sah , Dheeraj Peri , Ameya Shringi , Chi Zhang , Miguel Dominguez , Andreas Savakis , Ray Ptucha

Music captioning, or the task of generating a natural language description of music, is useful for both music understanding and controllable music generation. Training captioning models, however, typically requires high-quality music…

Sound · Computer Science 2026-02-04 Irmak Bukey , Zhepei Wang , Chris Donahue , Nicholas J. Bryan