中文
相关论文

相关论文: On the Distributed Evaluation of Generative Models

200 篇论文

A distinguishing characteristic of federated learning is that the (local) client data could have statistical heterogeneity. This heterogeneity has motivated the design of personalized learning, where individual (personalized) models are…

机器学习 · 计算机科学 2022-07-06 Kaan Ozkara , Antonious M. Girgis , Deepesh Data , Suhas Diggavi

Likelihood-based deep generative models such as score-based diffusion models and variational autoencoders are state-of-the-art machine learning models approximating high-dimensional distributions of data such as images, text, or audio. One…

机器学习 · 统计学 2024-05-28 Sam Dauncey , Chris Holmes , Christopher Williams , Fabian Falck

Joint machine learning models that allow synthesizing and classifying data often offer uneven performance between those tasks or are unstable to train. In this work, we depart from a set of empirical observations that indicate the…

机器学习 · 计算机科学 2023-04-06 Kamil Deja , Tomasz Trzcinski , Jakub M. Tomczak

Learning a categorical distribution comes with its own set of challenges. A successful approach taken by state-of-the-art works is to cast the problem in a continuous domain to take advantage of the impressive performance of the generative…

机器学习 · 计算机科学 2023-03-09 Florence Regol , Mark Coates

Evaluating generative adversarial networks (GANs) is inherently challenging. In this paper, we revisit several representative sample-based evaluation metrics for GANs, and address the problem of how to evaluate the evaluation metrics. We…

机器学习 · 计算机科学 2018-08-20 Qiantong Xu , Gao Huang , Yang Yuan , Chuan Guo , Yu Sun , Felix Wu , Kilian Weinberger

Decision Trees and Random Forests are among the most widely used machine learning models, and often achieve state-of-the-art performance in tabular, domain-agnostic datasets. Nonetheless, being primarily discriminative models they lack…

机器学习 · 统计学 2020-07-14 Alvaro H. C. Correia , Robert Peharz , Cassio de Campos

This paper investigates federated learning in a wireless communication system, where random device selection is employed with non-independent and identically distributed (non-IID) data. The analysis indicates that while training deep…

信号处理 · 电气工程与系统科学 2024-05-28 Kaidi Wang , Zhiguo Ding , Daniel K. C. So , Zhi Ding

Generative adversarial networks (GANs) have been extremely effective in approximating complex distributions of high-dimensional, input data samples, and substantial progress has been made in understanding and improving GAN performance in…

机器学习 · 计算机科学 2018-05-01 Daniel Jiwoong Im , He Ma , Graham Taylor , Kristin Branson

Federated learning (FL) allows collaborative machine learning (ML) model training among decentralized clients' information, ensuring data privacy. The decentralized nature of FL deals with non-independent and identically distributed…

Federated learning enables collaborative model training without sharing raw data, but its performance can degrade substantially under heterogeneous client data distributions. A single global model often cannot satisfy diverse client…

机器学习 · 计算机科学 2026-05-27 Yunseok Kang , Jaeyoung Song

Pervasive computing promotes the installation of connected devices in our living spaces in order to provide services. Two major developments have gained significant momentum recently: an advanced use of edge resources and the integration of…

机器学习 · 计算机科学 2021-10-22 Sannara Ek , François Portet , Philippe Lalanda , German Vega

A fundamental challenge to providing edge-AI services is the need for a machine learning (ML) model that achieves personalization (i.e., to individual clients) and generalization (i.e., to unseen data) properties concurrently. Existing…

机器学习 · 计算机科学 2023-02-14 Dong-Jun Han , Do-Yeon Kim , Minseok Choi , Christopher G. Brinton , Jaekyun Moon

Federated learning (FL) enables leveraging distributed private data for model training in a privacy-preserving way. However, data heterogeneity significantly limits the performance of current FL methods. In this paper, we propose a novel FL…

机器学习 · 计算机科学 2023-12-12 Rui Ye , Xinyu Zhu , Jingyi Chai , Siheng Chen , Yanfeng Wang

With the rise of neural models across the field of information retrieval, numerous publications have incrementally pushed the envelope of performance for a multitude of IR tasks. However, these networks often sample data in random order,…

信息检索 · 计算机科学 2018-06-12 Daniel Cohen , Scott M. Jordan , W. Bruce Croft

With privacy as a motivation, Federated Learning (FL) is an increasingly used paradigm where learning takes place collectively on edge devices, each with a cache of user-generated training examples that remain resident on the local device.…

机器学习 · 计算机科学 2021-11-25 Sean Augenstein , Andrew Hard , Kurt Partridge , Rajiv Mathews

We describe a probabilistic (generative) view of affinity matrices along with inference algorithms for a subclass of problems associated with data clustering. This probabilistic view is helpful in understanding different models and…

机器学习 · 计算机科学 2012-12-12 Romer Rosales , Brendan J. Frey

Federated Learning is an emerging distributed collaborative learning paradigm adopted by many of today's applications, e.g., keyboard prediction and object recognition. Its core principle is to learn from large amount of users data while…

分布式、并行与集群计算 · 计算机科学 2020-11-16 Jiyue Huang , Rania Talbi , Zilong Zhao , Sara Boucchenak , Lydia Y. Chen , Stefanie Roos

Many real-world problems require reasoning across multiple scales, demanding models which operate not on single data points, but on entire distributions. We introduce generative distribution embeddings (GDE), a framework that lifts…

机器学习 · 计算机科学 2026-02-23 Nic Fishman , Gokul Gowri , Peng Yin , Jonathan Gootenberg , Omar Abudayyeh

Generative Adversarial Networks (GANs) have shown remarkable results in modeling complex distributions, but their evaluation remains an unsettled issue. Evaluations are essential for: (i) relative assessment of different models and (ii)…

We categorize meta-learning evaluation into two settings: $\textit{in-distribution}$ [ID], in which the train and test tasks are sampled $\textit{iid}$ from the same underlying task distribution, and $\textit{out-of-distribution}$ [OOD], in…

机器学习 · 计算机科学 2021-10-29 Amrith Setlur , Oscar Li , Virginia Smith