English
Related papers

Related papers: On the Relation between Quality-Diversity Evaluati…

200 papers

Evaluation metrics in image synthesis play a key role to measure performances of generative models. However, most metrics mainly focus on image fidelity. Existing diversity metrics are derived by comparing distributions, and thus they…

Computer Vision and Pattern Recognition · Computer Science 2022-06-28 Jiyeon Han , Hwanil Choi , Yunjey Choi , Junho Kim , Jung-Woo Ha , Jaesik Choi

Recent advances in diffusion models have led to a quantum leap in the quality of generative visual content. However, quantification of realism of the content is still challenging. Existing evaluation metrics, such as Inception Score and…

Computer Vision and Pattern Recognition · Computer Science 2023-09-27 Yunzhuo Chen , Naveed Akhtar , Nur Al Hasan Haldar , Ajmal Mian

Text generation is of great importance to many natural language processing applications. However, maximization-based decoding methods (e.g. beam search) of neural language models often lead to degenerate solutions -- the generated text is…

Computation and Language · Computer Science 2022-09-27 Yixuan Su , Tian Lan , Yan Wang , Dani Yogatama , Lingpeng Kong , Nigel Collier

Text style transfer is an exciting task within the field of natural language generation that is often plagued by the need for high-quality paired datasets. Furthermore, training a model for multi-attribute text style transfer requires…

Computation and Language · Computer Science 2023-05-26 Debarati Das , David Ma , Dongyeop Kang

Statistical evaluation aims to estimate the generalization performance of a model using held-out i.i.d.\ test data sampled from the ground-truth distribution. In supervised learning settings such as classification, performance metrics such…

Machine Learning · Computer Science 2026-04-08 Shashaank Aiyer , Yishay Mansour , Shay Moran , Han Shao

When thinking about dressing oneself, people often have a theme in mind whether they're going to a tropical getaway or wish to appear attractive at a cocktail party. A useful outfit generation system should come up with clothing items that…

Computer Vision and Pattern Recognition · Computer Science 2019-11-19 Kedan Li , Chen Liu , David Forsyth

Diffusion models trained on different, non-overlapping subsets of a dataset often produce strikingly similar outputs when given the same noise seed. We trace this consistency to a simple linear effect: the shared Gaussian statistics across…

Machine Learning · Computer Science 2026-02-04 Binxu Wang , Jacob Zavatone-Veth , Cengiz Pehlevan

The unprecedented photorealistic results achieved by recent text-to-image generative systems and their increasing use as plug-and-play content creation solutions make it crucial to understand their potential biases. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Melissa Hall , Candace Ross , Adina Williams , Nicolas Carion , Michal Drozdzal , Adriana Romero Soriano

Diffusion generative models have emerged as powerful tools for producing synthetic data from an empirically observed distribution. A common approach involves simulating the time-reversal of an Ornstein-Uhlenbeck (OU) process initialized at…

Machine Learning · Statistics 2025-12-02 Valentin de Bortoli , Romuald Elie , Anna Kazeykina , Zhenjie Ren , Jiacheng Zhang

Most research about natural language generation (NLG) relies on evaluation benchmarks with limited references for a sample, which may result in poor correlations with human judgements. The underlying reason is that one semantic meaning can…

Computation and Language · Computer Science 2024-05-28 Tianyi Tang , Hongyuan Lu , Yuchen Eleanor Jiang , Haoyang Huang , Dongdong Zhang , Wayne Xin Zhao , Tom Kocmi , Furu Wei

Recent large language models (LLMs) have shown remarkable performance in aligning generated text with user intentions across various tasks. When it comes to long-form text generation, there has been a growing interest in generation from a…

Computation and Language · Computer Science 2024-04-04 Yinhong Liu , Yixuan Su , Ehsan Shareghi , Nigel Collier

In light of the widespread success of generative models, a significant amount of research has gone into speeding up their sampling time. However, generative models are often sampled multiple times to obtain a diverse set incurring a cost…

Machine Learning · Computer Science 2023-11-27 Gabriele Corso , Yilun Xu , Valentin de Bortoli , Regina Barzilay , Tommi Jaakkola

Textual image generation spans diverse fields like advertising, education, product packaging, social media, information visualization, and branding. Despite recent strides in language-guided image synthesis using diffusion models, current…

Computer Vision and Pattern Recognition · Computer Science 2024-05-22 Shubham Paliwal , Arushi Jain , Monika Sharma , Vikram Jamwal , Lovekesh Vig

Large language models benefit from training with a large amount of unlabeled text, which gives them increasingly fluent and diverse generation capabilities. However, using these models for text generation that takes into account target…

Computation and Language · Computer Science 2021-09-16 Dian Yu , Zhou Yu , Kenji Sagae

LLMs are not generally able to adjust the length of their outputs based on strict length requirements, a capability that would improve their usefulness in applications that require adherence to diverse user and system requirements. We…

Computation and Language · Computer Science 2025-02-27 Diana Marie Schenke , Timo Baumann

Diffusion models have become widely popular for automated floorplan generation, producing highly realistic layouts conditioned on user-defined constraints. However, optimizing for perceptual metrics such as the Fr\'echet Inception Distance…

Machine Learning · Computer Science 2026-02-03 Leonardo Stoppani , Davide Bacciu , Shahab Mokarizadeh

Divergence from a random baseline is a technique for the evaluation of document clustering. It ensures cluster quality measures are performing work that prevents ineffective clusterings from giving high scores to clusterings that provide no…

Information Retrieval · Computer Science 2012-08-30 Christopher M. De Vries , Shlomo Geva , Andrew Trotman

Current bundle generation studies focus on generating a combination of items to improve user experience. In real-world applications, there is also a great need to produce bundle creatives that consist of mixture types of objects (e.g.,…

Information Retrieval · Computer Science 2022-06-10 Penghui Wei , Shaoguo Liu , Xuanhua Yang , Liang Wang , Bo Zheng

Generative AI models have recently achieved astonishing results in quality and are consequently employed in a fast-growing number of applications. However, since they are highly data-driven, relying on billion-sized datasets randomly…

Diffusion models have been successfully adapted to text generation tasks by mapping the discrete text into the continuous space. However, there exist nonnegligible gaps between training and inference, owing to the absence of the forward…

Computation and Language · Computer Science 2023-05-09 Zecheng Tang , Pinzheng Wang , Keyan Zhou , Juntao Li , Ziqiang Cao , Min Zhang