StyleM: Stylized Metrics for Image Captioning Built with Contrastive N-grams
Computer Vision and Pattern Recognition
2022-01-05 v1 Artificial Intelligence
Computation and Language
Abstract
In this paper, we build two automatic evaluation metrics for evaluating the association between a machine-generated caption and a ground truth stylized caption: OnlyStyle and StyleCIDEr.
Cite
@article{arxiv.2201.00975,
title = {StyleM: Stylized Metrics for Image Captioning Built with Contrastive N-grams},
author = {Chengxi Li and Brent Harrison},
journal= {arXiv preprint arXiv:2201.00975},
year = {2022}
}
Related papers
View all related →
Computer Vision and Pattern Recognition · Computer Science
Diverse Image Captioning with Grounded Style
Franz Klein, Shweta Mahajan, Stefan Roth
2022-05-05
Computation and Language · Computer Science
TIGEr: Text-to-Image Grounding for Image Caption Evaluation
Ming Jiang, Qiuyuan Huang, Lei Zhang, Xin Wang +4
2019-09-06
Computer Vision and Pattern Recognition · Computer Science
Towards Unique and Informative Captioning of Images
Zeyu Wang, Berthy Feng, Karthik Narasimhan, Olga Russakovsky
2020-09-10
Computer Vision and Pattern Recognition · Computer Science
Learning to Evaluate Image Captioning
Yin Cui, Guandao Yang, Andreas Veit, Xun Huang +1
2018-06-19
Computer Vision and Pattern Recognition · Computer Science
Is An Image Worth Five Sentences? A New Look into Semantics for Image-Text Matching
Ali Furkan Biten, Andres Mafla, Lluis Gomez, Dimosthenis Karatzas
2021-10-07
Computer Vision and Pattern Recognition · Computer Science
SentiCap: Generating Image Descriptions with Sentiments
Alexander Mathews, Lexing Xie, Xuming He
2015-12-15
Artificial Intelligence · Computer Science
LCEval: Learned Composite Metric for Caption Evaluation
Naeha Sharif, Lyndon White, Mohammed Bennamoun, Wei Liu +1
2020-12-25
Computer Vision and Pattern Recognition · Computer Science
SPICE: Semantic Propositional Image Caption Evaluation
Peter Anderson, Basura Fernando, Mark Johnson, Stephen Gould
2016-08-01
Computer Vision and Pattern Recognition · Computer Science
Contrastive Semantic Similarity Learning for Image Captioning Evaluation with Intrinsic Auto-encoder
Chao Zeng, Tiesong Zhao, Sam Kwong
2021-06-30
Computer Vision and Pattern Recognition · Computer Science
"Factual" or "Emotional": Stylized Image Captioning with Adaptive Learning and Attention
Tianlang Chen, Zhongping Zhang, Quanzeng You, Chen Fang +3
2018-07-31
Computer Vision and Pattern Recognition · Computer Science
Are metrics measuring what they should? An evaluation of image captioning task metrics
Othón González-Chávez, Guillermo Ruiz, Daniela Moctezuma, Tania A. Ramirez-delReal
2023-02-15
Computation and Language · Computer Science
COSMic: A Coherence-Aware Generation Metric for Image Descriptions
Mert İnan, Piyush Sharma, Baber Khalid, Radu Soricut +2
2022-03-21
Computation and Language · Computer Science
A Self-Explainable Stylish Image Captioning Framework via Multi-References
Chengxi Li, Brent Harrison
2021-11-19
Computation and Language · Computer Science
Re-evaluating Automatic Metrics for Image Captioning
Mert Kilickaya, Aykut Erdem, Nazli Ikizler-Cinbis, Erkut Erdem
2016-12-23
Computer Vision and Pattern Recognition · Computer Science
Image Captioning with Clause-Focused Metrics in a Multi-Modal Setting for Marketing
Philipp Harzig, Dan Zecha, Rainer Lienhart, Carolin Kaiser +1
2019-08-07
Computer Vision and Pattern Recognition · Computer Science
JaSPICE: Automatic Evaluation Metric Using Predicate-Argument Structures for Image Captioning Models
Yuiga Wada, Kanta Kaneda, Komei Sugiura
2023-11-08
Computer Vision and Pattern Recognition · Computer Science
WEmbSim: A Simple yet Effective Metric for Image Captioning
Naeha Sharif, Lyndon White, Mohammed Bennamoun, Wei Liu +1
2020-12-25
Computer Vision and Pattern Recognition · Computer Science
Intrinsic Image Captioning Evaluation
Chao Zeng, Sam Kwong
2020-12-15
Computer Vision and Pattern Recognition · Computer Science
On Distinctive Image Captioning via Comparing and Reweighting
Jiuniu Wang, Wenjia Xu, Qingzhong Wang, Antoni B. Chan
2022-04-11
Computer Vision and Pattern Recognition · Computer Science
Automated Image Captioning with CNNs and Transformers
Joshua Adrian Cahyono, Jeremy Nathan Jusuf
2024-12-17
Computer Vision and Pattern Recognition · Computer Science
SemStyle: Learning to Generate Stylised Image Captions using Unaligned Text
Alexander Mathews, Lexing Xie, Xuming He
2018-05-21
Computer Vision and Pattern Recognition · Computer Science
Senti-Attend: Image Captioning using Sentiment and Attention
Omid Mohamad Nezami, Mark Dras, Stephen Wan, Cecile Paris
2018-11-27
Multimedia · Computer Science
Visual Captioning at Will: Describing Images and Videos Guided by a Few Stylized Sentences
Dingyi Yang, Hongyu Chen, Xinglin Hou, Tiezheng Ge +2
2023-08-01
Computation and Language · Computer Science
StyleCap: Automatic Speaking-Style Captioning from Speech Based on Speech and Language Self-supervised Learning Models
Kazuki Yamauchi, Yusuke Ijima, Yuki Saito
2023-12-29
Computer Vision and Pattern Recognition · Computer Science
3M: Multi-style image caption generation using Multi-modality features under Multi-UPDOWN model
Chengxi Li, Brent Harrison
2021-03-23