English
Related papers

Related papers: Adversarial Variational Optimization of Non-Differ…

200 papers

This paper proposes a black-box adversarial attack method to automatic speech recognition systems. Some studies have attempted to attack neural networks for speech recognition; however, these methods did not consider the robustness of…

Sound · Computer Science 2024-07-09 Shoma Ishida , Satoshi Ono

Variational inference (VI) combined with data subsampling enables approximate posterior inference over large data sets, but suffers from poor local optima. We first formulate a deterministic annealing approach for the generic class of…

Machine Learning · Statistics 2016-05-31 Stephan Mandt , James McInerney , Farhan Abrol , Rajesh Ranganath , David Blei

Generative adversarial imitation learning (GAIL) demonstrates tremendous success in practice, especially when combined with neural networks. Different from reinforcement learning, GAIL learns both policy and reward function from expert…

Machine Learning · Computer Science 2020-06-26 Yufeng Zhang , Qi Cai , Zhuoran Yang , Zhaoran Wang

Reliable training of generative adversarial networks (GANs) typically require massive datasets in order to model complicated distributions. However, in several applications, training samples obey invariances that are \textit{a priori}…

We propose a higher-level associative memory for learning adversarial networks. Generative adversarial network (GAN) framework has a discriminator and a generator network. The generator (G) maps white noise (z) to data samples while the…

Machine Learning · Computer Science 2016-11-23 Tarik Arici , Asli Celikyilmaz

We propose a general technique for improving alternating optimization (AO) of nonconvex functions. Starting from the solution given by AO, we conduct another sequence of searches over subspaces that are both meaningful to the optimization…

Computation · Statistics 2014-12-16 W. James Murdoch , Mu Zhu

Adversarial training methods typically align distributions by solving two-player games. However, in most current formulations, even if the generator aligns perfectly with data, a sub-optimal discriminator can still drive the two apart.…

Machine Learning · Computer Science 2020-02-21 Shangyuan Tong , Timur Garipov , Tommi Jaakkola

This paper studies Distributionally Robust Optimization (DRO), a fundamental framework for enhancing the robustness and generalization of statistical learning and optimization. An effective ambiguity set for DRO must involve distributions…

Machine Learning · Computer Science 2026-02-10 Jiaqi Wen , Jianyi Yang

In this paper we consider a distributed optimization scenario in which the aggregate objective function to minimize is partitioned, big-data and possibly non-convex. Specifically, we focus on a set-up in which the dimension of the decision…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-03-27 Ivano Notarnicola , Giuseppe Notarstefano

Domain Adaptation is an actively researched problem in Computer Vision. In this work, we propose an approach that leverages unsupervised data to bring the source and target distributions closer in a learned joint feature space. We…

Computer Vision and Pattern Recognition · Computer Science 2018-04-16 Swami Sankaranarayanan , Yogesh Balaji , Carlos D. Castillo , Rama Chellappa

Being able to generate constrained samples is one of the most appealing applications of the deep generators. Conditional generators are one of the successful implementations of such models wherein the created samples are constrained to a…

Image and Video Processing · Electrical Eng. & Systems 2018-05-29 Shabab Bazrafkan , Peter Corcoran

Distributionally robust optimization (DRO) has shown lot of promise in providing robustness in learning as well as sample based optimization problems. We endeavor to provide DRO solutions for a class of sum of fractionals, non-convex…

Machine Learning · Computer Science 2022-06-01 Avinandan Bose , Arunesh Sinha , Tien Mai

Any autoencoder network can be turned into a generative model by imposing an arbitrary prior distribution on its hidden code vector. Variational Autoencoder (VAE) [2] uses a KL divergence penalty to impose the prior, whereas Adversarial…

Machine Learning · Computer Science 2018-07-23 Mahdi Azarafrooz

Modern stochastic optimization pipelines increasingly rely on learned generative models to represent uncertainty, while downstream decisions are evaluated almost entirely through Monte Carlo scenarios. This shifts the operational object of…

Optimization and Control · Mathematics 2026-05-01 Ziwei Zhang , Jonathan Yu-Meng Li

We propose a new approach to train the Generative Adversarial Nets (GANs) with a mixture of generators to overcome the mode collapsing problem. The main intuition is to employ multiple generators, instead of using a single one as in the…

Machine Learning · Computer Science 2017-10-31 Quan Hoang , Tu Dinh Nguyen , Trung Le , Dinh Phung

All-vs-all orbital evolutionary simulations for the low Earth orbit (LEO) simulate the long term evolution of the LEO environment. Although these simulations typically offer the highest fidelity, they are also highly computationally…

Earth and Planetary Astrophysics · Physics 2025-03-12 Enrico M. Zucchelli , Daniel Jang , Richard Linares

In this paper, we propose to equip Generative Adversarial Networks with the ability to produce direct energy estimates for samples.Specifically, we propose a flexible adversarial training framework, and prove this framework not only ensures…

Machine Learning · Computer Science 2017-02-27 Zihang Dai , Amjad Almahairi , Philip Bachman , Eduard Hovy , Aaron Courville

The alternating minimization (AM) method is a fundamental method for minimizing convex functions whose variable consists of two blocks. How to efficiently solve each subproblems when applying the AM method is the most concerned task. In…

Optimization and Control · Mathematics 2015-01-16 Hui Zhang , Lizhi Cheng

Recently, increasing works have proposed to drive evolutionary algorithms using machine learning models. Usually, the performance of such model based evolutionary algorithms is highly dependent on the training qualities of the adopted…

Neural and Evolutionary Computing · Computer Science 2020-05-12 Cheng He , Shihua Huang , Ran Cheng , Kay Chen Tan , Yaochu Jin

In this paper, we study deep generative models for effective unsupervised learning. We propose VGAN, which works by minimizing a variational lower bound of the negative log likelihood (NLL) of an energy based model (EBM), where the model…

Machine Learning · Computer Science 2016-11-08 Shuangfei Zhai , Yu Cheng , Rogerio Feris , Zhongfei Zhang