English
Related papers

Related papers: Generation from Noisy Examples

200 papers

In this paper, we make a bold attempt toward an ambitious task: given a pre-trained classifier, we aim to reconstruct an image generator, without relying on any data samples. From a black-box perspective, this challenge seems intractable,…

Machine Learning · Computer Science 2023-12-06 Runpeng Yu , Xinchao Wang

We study language generation in the limit under bounded memory. In this task, a learner observes examples from an unknown target language one at a time and must eventually output only new valid examples. Prior work assumes access to the…

Data Structures and Algorithms · Computer Science 2026-05-29 Jon Kleinberg , Anay Mehrotra , Amin Saberi , Grigoris Velegkas

Nearly all identifiability results in unsupervised representation learning inspired by, e.g., independent component analysis, factor analysis, and causal representation learning, rely on assumptions of additive independent noise or…

Machine Learning · Computer Science 2025-03-24 Yujia Zheng , Yang Liu , Jiaxiong Yao , Yingyao Hu , Kun Zhang

Two recently introduced criteria for estimation of generative models are both based on a reduction to binary classification. Noise-contrastive estimation (NCE) is an estimation procedure in which a generative model is trained to be able to…

Machine Learning · Statistics 2015-05-22 Ian J. Goodfellow

A generative model may generate utter nonsense when it is fit to maximize the likelihood of observed data. This happens due to "model error," i.e., when the true data generating distribution does not fit within the class of generative…

Machine Learning · Computer Science 2018-02-21 Steve Hanneke , Adam Kalai , Gautam Kamath , Christos Tzamos

Most existing zero-shot learning methods consider the problem as a visual semantic embedding one. Given the demonstrated capability of Generative Adversarial Networks(GANs) to generate images, we instead leverage GANs to imagine unseen…

Computer Vision and Pattern Recognition · Computer Science 2018-05-22 Yizhe Zhu , Mohamed Elhoseiny , Bingchen Liu , Xi Peng , Ahmed Elgammal

Consider learning a generative model for time-series data. The sequential setting poses a unique challenge: Not only should the generator capture the conditional dynamics of (stepwise) transitions, but its open-loop rollouts should also…

Machine Learning · Statistics 2023-11-03 Daniel Jarrett , Ioana Bica , Mihaela van der Schaar

Generative sequence models are typically trained on sample sequences from natural or formal languages. It is a crucial question whether -- or to what extent -- sample-based training is able to capture the true structure of these languages,…

Machine Learning · Computer Science 2026-02-06 András Balogh , Márk Jelasity

Machine learning models, especially neural network (NN) classifiers, have acceptable performance and accuracy that leads to their wide adoption in different aspects of our daily lives. The underlying assumption is that these models are…

We present an approach for generating clarification questions with the goal of eliciting new information that would make the given textual context more complete. We propose that modeling hypothetical answers (to clarification questions) as…

Computation and Language · Computer Science 2019-04-05 Sudha Rao , Hal Daumé

We use Generative Adversarial Networks (GANs) to design a class conditional label noise (CCN) robust scheme for binary classification. It first generates a set of correctly labelled data points from noisy labelled data and 0.1% or 1% clean…

Machine Learning · Computer Science 2020-10-20 Sandhya Tripathi , N Hemachandra

Class-conditional generative models hold promise to overcome the shortcomings of their discriminative counterparts. They are a natural choice to solve discriminative tasks in a robust manner as they jointly optimize for predictive…

Machine Learning · Computer Science 2020-02-18 Ethan Fetaya , Jörn-Henrik Jacobsen , Will Grathwohl , Richard Zemel

Generative adversarial models are powerful tools to model structure in complex distributions for a variety of tasks. Current techniques for learning generative models require an access to samples which have high quality, and advanced…

Machine Learning · Computer Science 2018-07-03 Xinhan Di , Pengqian Yu , Meng Tian

Generative adversarial networks (GANs) are neural networks that learn data distributions through adversarial training. In intensive studies, recent GANs have shown promising results for reproducing training images. However, in spite of…

Computer Vision and Pattern Recognition · Computer Science 2020-04-01 Takuhiro Kaneko , Tatsuya Harada

Given a finite and noisy dataset generated with a closed-form mathematical model, when is it possible to learn the true generating model from the data alone? This is the question we investigate here. We show that this model-learning problem…

We consider a model of robust learning in an adversarial environment. The learner gets uncorrupted training data with access to possible corruptions that may be affected by the adversary during testing. The learner's goal is to build a…

Machine Learning · Computer Science 2022-07-04 Idan Attias , Aryeh Kontorovich , Yishay Mansour

In this paper, we propose a new and unified approach for nonparametric regression and conditional distribution learning. Our approach simultaneously estimates a regression function and a conditional generator using a generative learning…

Machine Learning · Statistics 2023-06-28 Shanshan Song , Tong Wang , Guohao Shen , Yuanyuan Lin , Jian Huang

Due to their complex nature, it is hard to characterize the ways in which machine learning models can misbehave or be exploited when deployed. Recent work on adversarial examples, i.e. inputs with minor perturbations that result in…

Machine Learning · Computer Science 2018-02-27 Zhengli Zhao , Dheeru Dua , Sameer Singh

Learning-based image denoising methods have been bounded to situations where well-aligned noisy and clean images are given, or samples are synthesized from predetermined noise models, e.g., Gaussian. While recent generative noise modeling…

Computer Vision and Pattern Recognition · Computer Science 2022-02-22 Geonwoon Jang , Wooseok Lee , Sanghyun Son , Kyoung Mu Lee

In crowded settings, the human brain can focus on speech from a target speaker, given prior knowledge of how they sound. We introduce a novel intelligent hearable system that achieves this capability, enabling target speech hearing to…

Sound · Computer Science 2024-05-31 Bandhav Veluri , Malek Itani , Tuochao Chen , Takuya Yoshioka , Shyamnath Gollakota