中文
相关论文

相关论文: Evaluation Metrics and Methods for Generative Mode…

200 篇论文

The development of generative artificial intelligence for human motion generation has expanded rapidly, necessitating a unified evaluation framework. This paper presents a detailed review of eight evaluation metrics for human motion…

计算机视觉与模式识别 · 计算机科学 2024-05-14 Ali Ismail-Fawaz , Maxime Devanne , Stefano Berretti , Jonathan Weber , Germain Forestier

Wireless sensing has been recognized as a key enabling technology for numerous emerging applications. For decades, the sensing performance was mostly evaluated from a reliability perspective, with the efficiency aspect widely unexplored.…

信号处理 · 电气工程与系统科学 2023-06-13 Fuwang Dong , Fan Liu , Shihang Lu , Yifeng Xiong

Generative models have been found effective for data synthesis due to their ability to capture complex underlying data distributions. The quality of generated data from these models is commonly evaluated by visual inspection for image…

机器学习 · 计算机科学 2022-10-18 Emily Muller , Xu Zheng , Jer Hayes

The ability to automatically estimate the quality and coverage of the samples produced by a generative model is a vital requirement for driving algorithm research. We present an evaluation metric that can separately and reliably measure…

机器学习 · 统计学 2019-10-31 Tuomas Kynkäänniemi , Tero Karras , Samuli Laine , Jaakko Lehtinen , Timo Aila

In recent years, numerous graph generative models (GGMs) have been proposed. However, evaluating these models remains a considerable challenge, primarily due to the difficulty in extracting meaningful graph features that accurately…

机器学习 · 计算机科学 2025-03-18 Chengen Wang , Murat Kantarcioglu

Expressive range analysis is a visualization-based technique used to evaluate the performance of generative models, particularly in game level generation. It typically employs two quantifiable metrics to position generated artifacts on a 2D…

机器学习 · 计算机科学 2025-04-09 Mahsa Bazzaz , Seth Cooper

Generative models have made immense progress in recent years, particularly in their ability to generate high quality images. However, that quality has been difficult to evaluate rigorously, with evaluation dominated by heuristic approaches…

计算机视觉与模式识别 · 计算机科学 2019-12-30 Y. Alex Kolchinski , Sharon Zhou , Shengjia Zhao , Mitchell Gordon , Stefano Ermon

In this work, we propose to study the global geometrical properties of generative models. We introduce a new Riemannian metric to assess the similarity between any two data points. Importantly, our metric is agnostic to the parametrization…

机器学习 · 计算机科学 2024-07-17 Beomsu Kim , Michael Puthawala , Jong Chul Ye , Emanuele Sansone

Channel estimation is a critical task in multiple-input multiple-output (MIMO) digital communications that substantially effects end-to-end system performance. In this work, we introduce a novel approach for channel estimation using deep…

信号处理 · 电气工程与系统科学 2022-11-09 Marius Arvinte , Jonathan I Tamir

One of the most significant challenges in statistical signal processing and machine learning is how to obtain a generative model that can produce samples of large-scale data distribution, such as images and speeches. Generative Adversarial…

计算机视觉与模式识别 · 计算机科学 2020-05-28 Pegah Salehi , Abdolah Chalechale , Maryam Taghizadeh

Multilayer networks allow one to represent diverse and coupled connectivity patterns --- e.g., time-dependence, multiple subsystems, or both --- that arise in many applications and which are difficult or awkward to incorporate into standard…

社会与信息网络 · 计算机科学 2020-05-06 Marya Bazzi , Lucas G. S. Jeub , Alex Arenas , Sam D. Howison , Mason A. Porter

We develop a measure for evaluating the performance of generative networks given two sets of images. A popular performance measure currently used to do this is the Fr\'echet Inception Distance (FID). FID assumes that images featurized using…

计算机视觉与模式识别 · 计算机科学 2022-07-26 Lorenzo Luzi , Carlos Ortiz Marrero , Nile Wynar , Richard G. Baraniuk , Michael J. Henry

Diffusion language models have seen exciting recent progress, offering far more flexibility in generative trajectories than autoregressive models. This flexibility has motivated a growing body of research into new approaches to diffusion…

机器学习 · 计算机科学 2026-04-06 Patrick Pynadath , Jiaxin Shi , Ruqi Zhang

Along with the prosperity of generative artificial intelligence (AI), its potential for solving conventional challenges in wireless communications has also surfaced. Inspired by this trend, we investigate the application of the advanced…

信息论 · 计算机科学 2026-03-10 Xingyu Zhou , Le Liang , Jing Zhang , Peiwen Jiang , Yong Li , Shi Jin

With the rapid development of Generative Artificial Intelligence (GAI) technology, Generative Diffusion Models (GDMs) have shown significant empowerment potential in the field of wireless networks due to advantages, such as noise…

信号处理 · 电气工程与系统科学 2026-03-04 Dayu Fan , Rui Meng , Xiaodong Xu , Yiming Liu , Guoshun Nan , Chenyuan Feng , Shujun Han , Song Gao , Bingxuan Xu , Dusit Niyato , Tony Q. S. Quek , Ping Zhang

The increasing demand for high-speed and reliable wireless networks has driven advancements in technologies such as millimeter-wave and 5G radios, which requires efficient planning and timely deployment of wireless access points. A critical…

网络与互联网体系结构 · 计算机科学 2025-01-14 Xuanhao Luo , Zhizhen Li , Zhiyuan Peng , Mingzhe Chen , Yuchen Liu

Generative adversarial networks or GANs are a type of generative modeling framework. GANs involve a pair of neural networks engaged in a competition in iteratively creating fake data, indistinguishable from the real data. One notable…

计算机视觉与模式识别 · 计算机科学 2021-06-17 Eric J. Nunn , Pejman Khadivi , Shadrokh Samavi

Diffusion models have recently driven significant breakthroughs in generative modeling. While state-of-the-art models produce high-quality samples on average, individual samples can still be low quality. Detecting such samples without human…

机器学习 · 计算机科学 2025-06-13 Metod Jazbec , Eliot Wong-Toi , Guoxuan Xia , Dan Zhang , Eric Nalisnick , Stephan Mandt

Devising domain- and model-agnostic evaluation metrics for generative models is an important and as yet unresolved problem. Most existing metrics, which were tailored solely to the image synthesis setup, exhibit a limited capacity for…

机器学习 · 计算机科学 2022-07-14 Ahmed M. Alaa , Boris van Breugel , Evgeny Saveliev , Mihaela van der Schaar

Evaluating the performance of generative models in image synthesis is a challenging task. Although the Fr\'echet Inception Distance is a widely accepted evaluation metric, it integrates different aspects (e.g., fidelity and diversity) of…

计算机视觉与模式识别 · 计算机科学 2021-06-07 Ryoungwoo Jang , Minjee Kim , Da-in Eun , Kyungjin Cho , Jiyeon Seo , Namkug Kim