English
Related papers

Related papers: Assessing Generative Models via Precision and Reca…

200 papers

Conditional Generative Adversarial Networks (cGANs) are finding increasingly widespread use in many application domains. Despite outstanding progress, quantitative evaluation of such models often involves multiple distinct metrics to assess…

Computer Vision and Pattern Recognition · Computer Science 2019-12-25 Terrance DeVries , Adriana Romero , Luis Pineda , Graham W. Taylor , Michal Drozdzal

Generative models learn the distribution of data from a sample dataset and can then generate new data instances. Recent advances in deep learning has brought forth improvements in generative model architectures, and some state-of-the-art…

Cryptography and Security · Computer Science 2021-07-30 Luke A. Bauer , Vincent Bindschaedler

In the visual generative area, discrete diffusion models are gaining traction for their efficiency and compatibility. However, pioneered attempts still fall behind their continuous counterparts, which we attribute to noise (absorbing state)…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Tianren Ma , Xiaosong Zhang , Boyu Yang , Junlan Feng , Qixiang Ye

Score-based diffusion models are a powerful class of generative models, but their practical use often depends on training neural networks to approximate the score function. Training-free diffusion models provide an attractive alternative by…

Numerical Analysis · Mathematics 2026-01-28 Pengjun Wang , Zezhong Zhang , Minglei Yang , Feng Bao , Yanzhao Cao , Guannan Zhang

We introduce a novel evaluation framework for Large Language Models (LLMs) such as \textsc{Llama-2} and \textsc{Mistral}, focusing on importing Precision and Recall metrics from image generation to text generation. This approach allows for…

Computation and Language · Computer Science 2024-06-05 Florian Le Bronnec , Alexandre Verine , Benjamin Negrevergne , Yann Chevaleyre , Alexandre Allauzen

Diffusion Models have become a cornerstone of modern generative AI for their exceptional generation quality and controllability. However, their inherent \textit{multi-step iterations} and \textit{complex backbone networks} lead to…

Despite the tremendous success of diffusion generative models in text-to-image generation, replicating this success in the domain of image compression has proven difficult. In this paper, we demonstrate that diffusion can significantly…

Image and Video Processing · Electrical Eng. & Systems 2024-03-11 Emiel Hoogeboom , Eirikur Agustsson , Fabian Mentzer , Luca Versari , George Toderici , Lucas Theis

While generative modeling has become prevalent across numerous research fields, its integration into the realm of image retrieval remains largely unexplored and underjustified. In this paper, we present a novel methodology, reframing image…

Computer Vision and Pattern Recognition · Computer Science 2024-07-25 Yidan Zhang , Ting Zhang , Dong Chen , Yujing Wang , Qi Chen , Xing Xie , Hao Sun , Weiwei Deng , Qi Zhang , Fan Yang , Mao Yang , Qingmin Liao , Jingdong Wang , Baining Guo

Generative Recommendation (GR) has emerged as a transformative paradigm that reformulates the traditional cascade ranking system into a sequence-to-item generation task, facilitated by the use of discrete Semantic IDs (SIDs). However,…

Information Retrieval · Computer Science 2026-02-25 Zesheng Wang , Longfei Xu , Weidong Deng , Huimin Yan , Kaikui Liu , Xiangxiang Chu

In this paper, we present a novel and effective inference approach to conduct both finite- and large-sample inference for high-dimensional linear regression models. This approach is developed under the so-called repro samples framework, in…

Methodology · Statistics 2025-12-01 Peng Wang , Min-Ge Xie , Linjun Zhang

The generative adversarial network (GAN) is an important model developed for high-dimensional distribution learning in recent years. However, there is a pressing need for a comprehensive method to understand its error convergence rate. In…

Machine Learning · Statistics 2023-10-25 Mahmud Hasan , Hailin Sang

Generative models aim to learn the distribution of observed data by generating new instances. With the advent of neural networks, deep generative models, including variational autoencoders (VAEs), generative adversarial networks (GANs), and…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Zifan Shi , Sida Peng , Yinghao Xu , Andreas Geiger , Yiyi Liao , Yujun Shen

Probabilistic generative models provide a powerful framework for representing data that avoids the expense of manual annotation typically needed by discriminative approaches. Model selection in this generative setting can be challenging,…

The rapid advancement of text-to-image Diffusion Models has led to their widespread public accessibility. However these models, trained on large internet datasets, can sometimes generate undesirable outputs. To mitigate this, approximate…

Machine Learning · Computer Science 2024-11-05 Andrea Schioppa , Emiel Hoogeboom , Jonathan Heek

Generative Adversarial Networks (GANs) have shown remarkable results in modeling complex distributions, but their evaluation remains an unsettled issue. Evaluations are essential for: (i) relative assessment of different models and (ii)…

With success on controlled tasks, generative models are being increasingly applied to humanitarian applications [1,2]. In this paper, we focus on the evaluation of a conditional generative model that illustrates the consequences of climate…

Machine Learning · Computer Science 2019-10-23 Sharon Zhou , Alexandra Luccioni , Gautier Cosne , Michael S. Bernstein , Yoshua Bengio

Diffusion-based generative models learn to iteratively transfer unstructured noise to a complex target distribution as opposed to Generative Adversarial Networks (GANs) or the decoder of Variational Autoencoders (VAEs) which produce samples…

Machine Learning · Computer Science 2022-10-26 Sarthak Mittal , Guillaume Lajoie , Stefan Bauer , Arash Mehrjou

Generative adversarial nets (GANs) have become a preferred tool for tasks involving complicated distributions. To stabilise the training and reduce the mode collapse of GANs, one of their main variants employs the integral probability…

Machine Learning · Computer Science 2020-10-27 Shengxi Li , Zeyang Yu , Min Xiang , Danilo Mandic

Generative models, such as large language models and text-to-image diffusion models, produce relevant information when presented a query. Different models may produce different information when presented the same query. As the landscape of…

Machine Learning · Computer Science 2025-01-20 Aranyak Acharyya , Michael W. Trosset , Carey E. Priebe , Hayden S. Helm

The purpose of unconditional text generation is to train a model with real sentences, then generate novel sentences of the same quality and diversity as the training data. However, when different metrics are used for comparing the methods…

Computation and Language · Computer Science 2020-07-03 Ping Cai , Xingyuan Chen , Peng Jin , Hongjun Wang , Tianrui Li