English
Related papers

Related papers: Lipschitz Constrained GANs via Boundedness and Con…

200 papers

Generative Adversarial Networks (GANs) have made significant progress in enhancing the quality of image synthesis. Recent methods frequently leverage pretrained networks to calculate perceptual losses or utilize pretrained feature spaces.…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Geonhui Son , Jeong Ryong Lee , Dosik Hwang

Reinforcement learning (RL) has shown great potential in training agile and adaptable controllers for legged robots, enabling them to learn complex locomotion behaviors directly from experience. However, policies trained in simulation often…

Robotics · Computer Science 2026-03-23 Jaeyong Shin , Woohyun Cha , Donghyeon Kim , Junhyeok Cha , Jaeheung Park

Predictive coding (PC) is a general theory of cortical function. The local, gradient-based learning rules found in one kind of PC model have recently been shown to closely approximate backpropagation. This finding suggests that this…

Neural and Evolutionary Computing · Computer Science 2021-12-09 Nick Alonso , Emre Neftci

Despite the substantial progress in recent years, the image captioning techniques are still far from being perfect.Sentences produced by existing methods, e.g. those based on RNNs, are often overly rigid and lacking in variability. This…

Computer Vision and Pattern Recognition · Computer Science 2017-08-14 Bo Dai , Sanja Fidler , Raquel Urtasun , Dahua Lin

Generative adversarial networks (GANs) are a framework that learns a generative distribution through adversarial training. Recently, their class-conditional extensions (e.g., conditional GAN (cGAN) and auxiliary classifier GAN (AC-GAN))…

Computer Vision and Pattern Recognition · Computer Science 2019-05-06 Takuhiro Kaneko , Yoshitaka Ushiku , Tatsuya Harada

Despite the recent success of reinforcement learning in various domains, these approaches remain, for the most part, deterringly sensitive to hyper-parameters and are often riddled with essential engineering feats allowing their success. We…

Machine Learning · Computer Science 2023-10-26 Lionel Blondé , Pablo Strasser , Alexandros Kalousis

While Generative Adversarial Networks (GANs) have empirically produced impressive results on learning complex real-world distributions, recent works have shown that they suffer from lack of diversity or mode collapse. The theoretical work…

Machine Learning · Computer Science 2019-07-02 Yu Bai , Tengyu Ma , Andrej Risteski

Class imbalance occurs in many real-world applications, including image classification, where the number of images in each class differs significantly. With imbalanced data, the generative adversarial networks (GANs) leans to majority class…

Computer Vision and Pattern Recognition · Computer Science 2022-01-14 Yuchong Yao , Xiaohui Wangr , Yuanbang Ma , Han Fang , Jiaying Wei , Liyuan Chen , Ali Anaissi , Ali Braytee

Improving adversarial robustness of neural networks remains a major challenge. Fundamentally, training a neural network via gradient descent is a parameter estimation problem. In adaptive control, maintaining persistency of excitation (PoE)…

Machine Learning · Statistics 2021-10-18 Kaustubh Sridhar , Oleg Sokolsky , Insup Lee , James Weimer

GANs involve training two networks in an adversarial game, where each network's task depends on its adversary. Recently, several works have framed GAN training as an online or continual learning problem. We focus on the discriminator, which…

Machine Learning · Computer Science 2018-12-06 Ting Chen , Xiaohua Zhai , Neil Houlsby

Despite the successes in capturing continuous distributions, the application of generative adversarial networks (GANs) to discrete settings, like natural language tasks, is rather restricted. The fundamental reason is the difficulty of…

Artificial Intelligence · Computer Science 2017-02-28 Tong Che , Yanran Li , Ruixiang Zhang , R Devon Hjelm , Wenjie Li , Yangqiu Song , Yoshua Bengio

Generative adversarial networks (GANs) have emerged as a powerful tool for generating high-fidelity data. However, the main bottleneck of existing approaches is the lack of supervision on the generator training, which often results in…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Baoren Xiao , Hao Ni , Weixin Yang

Though recent research has achieved remarkable progress in generating realistic images with generative adversarial networks (GANs), the lack of training stability is still a lingering concern of most GANs, especially on high-resolution…

Computer Vision and Pattern Recognition · Computer Science 2020-03-18 Runmin Wu , Kunyao Zhang , Lijun Wang , Yue Wang , Pingping Zhang , Huchuan Lu , Yizhou Yu

Unsupervised learning of generative models has seen tremendous progress over recent years, in particular due to generative adversarial networks (GANs), variational autoencoders, and flow-based models. GANs have dramatically improved sample…

Computer Vision and Pattern Recognition · Computer Science 2020-01-06 Thomas Lucas , Konstantin Shmelkov , Karteek Alahari , Cordelia Schmid , Jakob Verbeek

We present two first-order, sequential optimization algorithms to solve constrained optimization problems. We consider a black-box setting with a priori unknown, non-convex objective and constraint functions that have Lipschitz continuous…

Optimization and Control · Mathematics 2020-11-19 Abraham P. Vinod , Arie Israel , Ufuk Topcu

Generative adversarial networks (GANs) are a novel approach to generative modelling, a task whose goal it is to learn a distribution of real data points. They have often proved difficult to train: GANs are unlike many techniques in machine…

Machine Learning · Computer Science 2018-07-02 Samuel A. Barnett

In Bitcoin entity classification, results are strongly conditioned by the ground-truth dataset, especially when applying supervised machine learning approaches. However, these ground-truth datasets are frequently affected by significant…

Machine Learning · Computer Science 2020-05-28 Francesco Zola , Jan Lukas Bruse , Xabier Etxeberria Barrio , Mikel Galar , Raul Orduna Urrutia

Recent advances in adversarial attacks and Wasserstein GANs have advocated for use of neural networks with restricted Lipschitz constants. Motivated by these observations, we study the recently introduced GroupSort neural networks, with…

Machine Learning · Statistics 2021-02-09 Ugo Tanielian , Maxime Sangnier , Gerard Biau

We propose a method for efficiently incorporating constraints into a stochastic gradient Langevin framework for the training of deep neural networks. Constraints allow direct control of the parameter space of the model. Appropriately…

Machine Learning · Computer Science 2021-06-22 Benedict Leimkuhler , Timothée Pouchon , Tiffany Vlaar , Amos Storkey

We establish a layer-wise parameterization for 1D convolutional neural networks (CNNs) with built-in end-to-end robustness guarantees. In doing so, we use the Lipschitz constant of the input-output mapping characterized by a CNN as a…

Machine Learning · Computer Science 2024-01-26 Patricia Pauli , Ruigang Wang , Ian R. Manchester , Frank Allgöwer