English
Related papers

Related papers: Leverage Score Sampling for Complete Mode Coverage…

200 papers

Generative adversarial networks (GANs) have been shown to provide an effective way to model complex distributions and have obtained impressive results on various challenging tasks. However, typical GANs require fully-observed data during…

Machine Learning · Computer Science 2019-02-27 Steven Cheng-Xian Li , Bo Jiang , Benjamin Marlin

Generative adversarial networks (GANs) are innovative techniques for learning generative models of complex data distributions from samples. Despite remarkable recent improvements in generating realistic images, one of their major…

Machine Learning · Computer Science 2018-11-05 Zinan Lin , Ashish Khetan , Giulia Fanti , Sewoong Oh

One popular method for dealing with large-scale data sets is sampling. For example, by using the empirical statistical leverage scores as an importance sampling distribution, the method of algorithmic leveraging samples and rescales…

Methodology · Statistics 2013-06-25 Ping Ma , Michael W. Mahoney , Bin Yu

We explain theoretically a curious empirical phenomenon: "Approximating a matrix by deterministically selecting a subset of its columns with the corresponding largest leverage scores results in a good low-rank matrix surrogate". To obtain…

Data Structures and Algorithms · Computer Science 2014-06-04 Dimitris Papailiopoulos , Anastasios Kyrillidis , Christos Boutsidis

This paper addresses the mode collapse for generative adversarial networks (GANs). We view modes as a geometric structure of data distribution in a metric space. Under this geometric lens, we embed subsamples of the dataset from an…

Machine Learning · Statistics 2019-06-12 Chang Xiao , Peilin Zhong , Changxi Zheng

Generative adversarial networks (GANs) form a generative modeling approach known for producing appealing samples, but they are notably difficult to train. One common way to tackle this issue has been to propose new formulations of the GAN…

Machine Learning · Computer Science 2020-09-01 Gauthier Gidel , Hugo Berard , Gaëtan Vignoud , Pascal Vincent , Simon Lacoste-Julien

We consider the most common variants of linear regression, including Ridge, Lasso and Support-vector regression, in a setting where the learner is allowed to observe only a fixed number of attributes of each example at training time. We…

Machine Learning · Computer Science 2015-03-19 Elad Hazan , Tomer Koren

In order to mimic the human ability of continual acquisition and transfer of knowledge across various tasks, a learning system needs the capability for continual learning, effectively utilizing the previously acquired skills. As such, the…

Machine Learning · Computer Science 2019-08-02 Dan Teng , Sakyasingha Dasgupta

Generative Adversarial Networks (GANs) are a class of generative models used for various applications, but they have been known to suffer from the mode collapse problem, in which some modes of the target distribution are ignored by the…

Computer Vision and Pattern Recognition · Computer Science 2021-12-30 Karttikeya Mangalam , Rohin Garg

Generative Adversarial Networks (GANs) are powerful generative models that achieved strong results, mainly in the image domain. However, the training of GANs is not trivial, presenting some challenges tackled by different strategies.…

Neural and Evolutionary Computing · Computer Science 2021-02-26 Victor Costa , Nuno Lourenço , João Correia , Penousal Machado

Generative Adversarial Networks (GANs) have shown compelling results in various tasks and applications in recent years. However, mode collapse remains a critical problem in GANs. In this paper, we propose a novel training pipeline to…

Computer Vision and Pattern Recognition · Computer Science 2023-04-11 Haozhe Liu , Bing Li , Haoqian Wu , Hanbang Liang , Yawen Huang , Yuexiang Li , Bernard Ghanem , Yefeng Zheng

Generative Adversarial Networks (GANs) are performant generative methods yielding high-quality samples. However, under certain circumstances, the training of GANs can lead to mode collapse or mode dropping, i.e. the generative models not…

Machine Learning · Computer Science 2021-04-28 Hannes De Meulemeester , Joachim Schreurs , Michaël Fanuel , Bart De Moor , Johan A. K. Suykens

Modern scientific research and applications very often encounter "fragmentary data" which brings big challenges to imputation and prediction. By leveraging the structure of response patterns, we propose a unified and flexible framework…

Machine Learning · Computer Science 2022-03-10 Fang Fang , Shenliao Bao

Generative adversarial networks (GANs) have achieved rapid progress in learning rich data distributions. However, we argue about two main issues in existing techniques. First, the low quality problem where the learned distribution has…

Computer Vision and Pattern Recognition · Computer Science 2020-07-01 Shuyang Gu , Jianmin Bao , Dong Chen , Fang Wen

Leverage scores have become essential in statistics and machine learning, aiding regression analysis, randomized matrix computations, and various other tasks. This paper delves into the inverse problem, aiming to recover the intrinsic model…

Machine Learning · Computer Science 2024-08-22 Chenyang Li , Zhao Song , Zhaoxing Xu , Junze Yin

Despite remarkable performance in producing realistic samples, Generative Adversarial Networks (GANs) often produce low-quality samples near low-density regions of the data manifold, e.g., samples of minor groups. Many techniques have been…

Machine Learning · Computer Science 2021-10-28 Jinhee Lee , Haeri Kim , Youngkyu Hong , Hye Won Chung

Generative Adversarial Networks (GANs) typically suffer from overfitting when limited training data is available. To facilitate GAN training, current methods propose to use data-specific augmentation techniques. Despite the effectiveness,…

Computer Vision and Pattern Recognition · Computer Science 2022-11-07 Jie Cao , Mandi Luo , Junchi Yu , Ming-Hsuan Yang , Ran He

In statistics and machine learning, logistic regression is a widely-used supervised learning technique primarily employed for binary classification tasks. When the number of observations greatly exceeds the number of predictor variables, we…

Machine Learning · Statistics 2024-04-02 Agniva Chowdhury , Pradeep Ramuhalli

Numerous task-specific variants of conditional generative adversarial networks have been developed for image completion. Yet, a serious limitation remains that all existing algorithms tend to fail when handling large-scale missing regions.…

Computer Vision and Pattern Recognition · Computer Science 2021-03-19 Shengyu Zhao , Jonathan Cui , Yilun Sheng , Yue Dong , Xiao Liang , Eric I Chang , Yan Xu

Recent generative models based on score matching and flow matching have significantly advanced generation tasks, but their potential in discriminative tasks remains underexplored. Previous approaches, such as generative classifiers, have…

Computer Vision and Pattern Recognition · Computer Science 2025-08-14 Rongkun Xue , Jinouwen Zhang , Yazhe Niu , Dazhong Shen , Bingqi Ma , Yu Liu , Jing Yang