English
Related papers

Related papers: Toward Verifiable and Reproducible Human Evaluatio…

200 papers

Research in Image Generation has recently made significant progress, particularly boosted by the introduction of Vision-Language models which are able to produce high-quality visual content based on textual inputs. Despite ongoing…

Computer Vision and Pattern Recognition · Computer Science 2023-07-20 Federico Betti , Jacopo Staiano , Lorenzo Baraldi , Lorenzo Baraldi , Rita Cucchiara , Nicu Sebe

There is significant interest in developing evaluation metrics which accurately estimate the quality of generated text without the aid of a human-written reference text, which can be time consuming and expensive to collect or entirely…

Computation and Language · Computer Science 2022-10-25 Daniel Deutsch , Rotem Dror , Dan Roth

Rapid progress in text-to-image generative models coupled with their deployment for visual content creation has magnified the importance of thoroughly evaluating their performance and identifying potential biases. In pursuit of models that…

Computer Vision and Pattern Recognition · Computer Science 2024-05-08 Melissa Hall , Samuel J. Bell , Candace Ross , Adina Williams , Michal Drozdzal , Adriana Romero Soriano

In this work, we systematically study the problem of personalized text-to-image generation, where the output image is expected to portray information about specific human subjects. E.g., generating images of oneself appearing at imaginative…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Panos Achlioptas , Alexandros Benetatos , Iordanis Fostiropoulos , Dimitris Skourtis

Automatic evaluation metrics capable of replacing human judgments are critical to allowing fast development of new methods. Thus, numerous research efforts have focused on crafting such metrics. In this work, we take a step back and analyze…

Computation and Language · Computer Science 2022-10-10 Pierre Colombo , Maxime Peyrard , Nathan Noiry , Robert West , Pablo Piantanida

Image classifiers should be used with caution in the real world. Performance evaluated on a validation set may not reflect performance in the real world. In particular, classifiers may perform well for conditions that are frequently…

Computer Vision and Pattern Recognition · Computer Science 2024-09-30 Adrien LeCoz , Houssem Ouertatani , Stéphane Herbin , Faouzi Adjed

Evaluating the quality of automatically generated image descriptions is a complex task that requires metrics capturing various dimensions, such as grammaticality, coverage, accuracy, and truthfulness. Although human evaluation provides…

Computer Vision and Pattern Recognition · Computer Science 2024-11-11 Jia-Hong Huang , Hongyi Zhu , Yixian Shen , Stevan Rudinac , Evangelos Kanoulas

Although current state-of-the-art language models have achieved impressive results in numerous natural language processing tasks, still they could not solve the problem of producing repetitive, dull and sometimes inconsistent text in…

Computation and Language · Computer Science 2021-08-10 An Nguyen

Recent breakthroughs in diffusion models, multimodal pretraining, and efficient finetuning have led to an explosion of text-to-image generative models. Given human evaluation is expensive and difficult to scale, automated methods are…

Computer Vision and Pattern Recognition · Computer Science 2023-10-19 Dhruba Ghosh , Hanna Hajishirzi , Ludwig Schmidt

The recent explosion of high-quality image-to-image methods has prompted interest in applying image-to-image methods towards artistic and design tasks. Of interest for architects is to use these methods to generate design proposals from…

Computer Vision and Pattern Recognition · Computer Science 2023-03-22 Eric Yeh , Briland Hitaj , Vidyasagar Sadhu , Anirban Roy , Takuma Nakabayashi , Yoshito Tsuji

Evaluating the quality of videos generated from text-to-video (T2V) models is important if they are to produce plausible outputs that convince a viewer of their authenticity. We examine some of the metrics used in this area and highlight…

Computer Vision and Pattern Recognition · Computer Science 2023-09-18 Iya Chivileva , Philip Lynch , Tomas E. Ward , Alan F. Smeaton

Generative models have demonstrated remarkable capability in synthesizing high-quality text, images, and videos. For video generation, contemporary text-to-video models exhibit impressive capabilities, crafting visually stunning videos.…

Computer Vision and Pattern Recognition · Computer Science 2024-01-17 Jay Zhangjie Wu , Guian Fang , Haoning Wu , Xintao Wang , Yixiao Ge , Xiaodong Cun , David Junhao Zhang , Jia-Wei Liu , Yuchao Gu , Rui Zhao , Weisi Lin , Wynne Hsu , Ying Shan , Mike Zheng Shou

Text Style Transfer (TST) evaluation is, in practice, inconsistent. Therefore, we conduct a meta-analysis on human and automated TST evaluation and experimentation that thoroughly examines existing literature in the field. The meta-analysis…

Machine Learning · Computer Science 2023-06-02 Phil Ostheimer , Mayank Nagda , Marius Kloft , Sophie Fellenz

Inferring evaluation scores based on human judgments is invaluable compared to using current evaluation metrics which are not suitable for real-time applications e.g. post-editing. However, these judgments are much more expensive to collect…

Computation and Language · Computer Science 2013-07-09 Ibrahim Sabek , Noha A. Yousri , Nagwa Elmakky , Mona Habib

Personalized text-to-image generation has attracted unprecedented attention in the recent few years due to its unique capability of generating highly-personalized images via using the input concept dataset and novel textual prompt. However,…

Artificial Intelligence · Computer Science 2024-07-02 Shian Du , Xiaotian Cheng , Qi Qian , Henglu Wei , Yi Xu , Xiangyang Ji

Recently, a myriad of conditional image generation and editing models have been developed to serve different downstream tasks, including text-to-image generation, text-guided image editing, subject-driven image generation, control-guided…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Max Ku , Tianle Li , Kai Zhang , Yujie Lu , Xingyu Fu , Wenwen Zhuang , Wenhu Chen

Evaluating and comparing text-to-image models is a challenging problem. Significant advances in the field have recently been made, piquing interest of various industrial sectors. As a consequence, a gold standard in the field should cover a…

Computer Vision and Pattern Recognition · Computer Science 2022-12-16 Federico A. Galatolo , Mario G. C. A. Cimino , Edoardo Cogotti

Recent advances in text-to-speech (TTS) technology have enabled systems to generate speech that is often indistinguishable from human speech, bringing benefits to accessibility, content creation, and human-computer interaction. However,…

Audio and Speech Processing · Electrical Eng. & Systems 2026-05-26 Yifan Yang , Hui Wang , Bing Han , Shujie Liu , Jinyu Li , Yong Qin , Xie Chen

Background. Reproducibility is essential to the scientific method, but reproduction is often a laborious task. Recent works have attempted to automate this process and relieve researchers of this workload. However, due to varying…

Computers and Society · Computer Science 2026-01-09 Thijs Snelleman , Peter Lundestad Lawrence , Holger H. Hoos , Odd Erik Gundersen