English
Related papers

Related papers: Quantifying Quality of Class-Conditional Generativ…

200 papers

Statistical evaluation aims to estimate the generalization performance of a model using held-out i.i.d.\ test data sampled from the ground-truth distribution. In supervised learning settings such as classification, performance metrics such…

Machine Learning · Computer Science 2026-04-08 Shashaank Aiyer , Yishay Mansour , Shay Moran , Han Shao

Imagine generating a city's electricity demand pattern based on weather, the presence of an electric vehicle, and location, which could be used for capacity planning during a winter freeze. Such real-world time series are often enriched…

Machine Learning · Computer Science 2025-10-31 Sai Shankar Narasimhan , Shubhankar Agarwal , Oguzhan Akcin , Sujay Sanghavi , Sandeep Chinchali

Devising domain- and model-agnostic evaluation metrics for generative models is an important and as yet unresolved problem. Most existing metrics, which were tailored solely to the image synthesis setup, exhibit a limited capacity for…

Machine Learning · Computer Science 2022-07-14 Ahmed M. Alaa , Boris van Breugel , Evgeny Saveliev , Mihaela van der Schaar

Learner performance data collected by Intelligent Tutoring Systems (ITSs), such as responses to questions, is essential for modeling and predicting learners' knowledge states. However, missing responses due to skips or incomplete attempts…

This paper shows that two commonly used evaluation metrics for generative models, the Fr\'echet Inception Distance (FID) and the Inception Score (IS), are biased -- the expected value of the score computed for a finite sample set is not the…

Computer Vision and Pattern Recognition · Computer Science 2020-06-17 Min Jin Chong , David Forsyth

Generative adversarial networks or GANs are a type of generative modeling framework. GANs involve a pair of neural networks engaged in a competition in iteratively creating fake data, indistinguishable from the real data. One notable…

Computer Vision and Pattern Recognition · Computer Science 2021-06-17 Eric J. Nunn , Pejman Khadivi , Shadrokh Samavi

This paper proposes an iterative generative model for solving the automatic colorization problem. Although previous researches have shown the capability to generate plausible color, the edge color overflow and the requirement of the…

Computer Vision and Pattern Recognition · Computer Science 2020-12-29 Kai Hong , Jin Li , Wanyun Li , Cailian Yang , Minghui Zhang , Yuhao Wang , Qiegen Liu

Synthetic tabular data generation has emerged as a promising method to address limited data availability and privacy concerns. With the sharp increase in the performance of large language models in recent years, researchers have been…

Machine Learning · Computer Science 2025-03-28 Reilly Cannon , Nicolette M. Laird , Caesar Vazquez , Andy Lin , Amy Wagler , Tony Chiang

Deep generative models are becoming increasingly powerful, now generating diverse high fidelity photo-realistic samples given text prompts. Have they reached the point where models of natural images can be used for generative data…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Shekoofeh Azizi , Simon Kornblith , Chitwan Saharia , Mohammad Norouzi , David J. Fleet

Most existing time series classification methods adopt a discriminative paradigm that maps input sequences directly to one-hot encoded class labels. While effective, this paradigm struggles to incorporate contextual features and fails to…

Machine Learning · Computer Science 2026-01-22 Mingyue Cheng , Xiaoyu Tao , Huajian Zhang , Qi Liu , Enhong Chen

We present a novel framework for leveraging synthetic ICU time-series data not only to train but also to rigorously and trustworthily evaluate predictive models, both at the population level and within fine-grained demographic subgroups.…

Machine Learning · Computer Science 2025-10-23 Mahmoud Ibrahim , Bart Elen , Chang Sun , Gökhan Ertaylan , Michel Dumontier

Devising indicative evaluation metrics for the image generation task remains an open problem. The most widely used metric for measuring the similarity between real and generated images has been the Fr\'echet Inception Distance (FID) score.…

Computer Vision and Pattern Recognition · Computer Science 2020-06-30 Muhammad Ferjad Naeem , Seong Joon Oh , Youngjung Uh , Yunjey Choi , Jaejun Yoo

Most evaluations of generative models rely on feature-distribution metrics such as FID, which operate on continuous recognition features that are explicitly trained to be invariant to appearance variations, and thus discard cues critical…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Zexi Jia , Pengcheng Luo , Yijia Zhong , Jinchao Zhang , Jie Zhou

Recent advances in Generative Adversarial Networks (GANs) have led to their widespread adoption for the purposes of generating high quality synthetic imagery. While capable of generating photo-realistic images, these models often produce…

Computer Vision and Pattern Recognition · Computer Science 2020-10-26 Terrance DeVries , Michal Drozdzal , Graham W. Taylor

Although deep learning has achieved appealing results on several machine learning tasks, most of the models are deterministic at inference, limiting their application to single-modal settings. We propose a novel general-purpose framework…

Machine Learning · Computer Science 2020-10-12 Sameera Ramasinghe , Kanchana Ranasinghe , Salman Khan , Nick Barnes , Stephen Gould

Data scarcity remains a critical bottleneck impeding technological advancements across various domains, including but not limited to medicine and precision agriculture. To address this challenge, we explore the potential of Deep Generative…

Machine Learning · Computer Science 2025-04-16 Marco Salmè , Lorenzo Tronchin , Rosa Sicilia , Paolo Soda , Valerio Guarrasi

Text-to-Time Series generation holds significant potential to address challenges such as data sparsity, imbalance, and limited availability of multimodal time series datasets across domains. While diffusion models have achieved remarkable…

Machine Learning · Computer Science 2025-05-09 Yunfeng Ge , Jiawei Li , Yiji Zhao , Haomin Wen , Zhao Li , Meikang Qiu , Hongyan Li , Ming Jin , Shirui Pan

High-fidelity generative models are increasingly needed in privacy-sensitive scenarios, where access to data is severely restricted due to regulatory and copyright constraints. This scarcity hampers model development--ironically, in…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Xuemei Jia , Jiawei Du , Hui Wei , Jun Chen , Joey Tianyi Zhou , Zheng Wang

Cognitive diagnosis (CD) models latent cognitive states of human learners by analyzing their response patterns on diagnostic tests, serving as a crucial machine learning technique for educational assessment and evaluation. Traditional…

Machine Learning · Computer Science 2025-07-15 Jiatong Li , Qi Liu , Mengxiao Zhu

Generative Adversarial Networks (GANs) have proven to be a powerful tool for generating realistic synthetic data. However, traditional GANs often struggle to capture complex relationships between features which results in generation of…

Machine Learning · Computer Science 2023-06-06 Srikrishna Iyer , Teng Teck Hou