English
Related papers

Related papers: Autonomously and Simultaneously Refining Deep Neur…

200 papers

In this work, we explore the potential of self-supervised learning with Generative Adversarial Networks (GANs) for electron microscopy datasets. We show how self-supervised pretraining facilitates efficient fine-tuning for a spectrum of…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Bashir Kazimi , Karina Ruzaeva , Stefan Sandfeld

Deep Learning has gained immense success in pushing today's artificial intelligence forward. To solve the challenge of limited labeled data in the supervised learning world, unsupervised learning has been proposed years ago while low…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-09-10 F. Liu , C. Liu , F. Bi

Designing resource-efficient Deep Neural Networks (DNNs) is critical to deploy deep learning solutions over edge platforms due to diverse performance, power, and memory budgets. Unfortunately, it is often the case a well-trained ML model…

Machine Learning · Computer Science 2020-06-09 Sheng-Chun Kao , Arun Ramamurthy , Reed Williams , Tushar Krishna

The task of image generation started to receive some attention from artists and designers to inspire them in new creations. However, exploiting the results of deep generative models such as Generative Adversarial Networks can be long and…

Computer Vision and Pattern Recognition · Computer Science 2021-04-05 Baptiste Rozière , Morgane Riviere , Olivier Teytaud , Jérémy Rapin , Yann LeCun , Camille Couprie

We propose a new architecture and training methodology for generative adversarial networks. Current approaches attempt to learn the transformation from a noise sample to a generated data sample in one shot. Our proposed generator…

Machine Learning · Computer Science 2018-11-26 Safwan Hossain , Kiarash Jamali , Yuchen Li , Frank Rudzicz

Optimising deep neural networks is a challenging task due to complex training dynamics, high computational requirements, and long training times. To address this difficulty, we propose the framework of Generalisable Agents for Neural…

Deep neural networks (DNNs) have greatly contributed to the performance gains in semantic segmentation. Nevertheless, training DNNs generally requires large amounts of pixel-level labeled data, which is expensive and time-consuming to…

Computer Vision and Pattern Recognition · Computer Science 2023-01-02 Yonghao Xu , Fengxiang He , Bo Du , Dacheng Tao , Liangpei Zhang

Generative adversarial networks (GANs) have great successes on synthesizing data. However, the existing GANs restrict the discriminator to be a binary classifier, and thus limit their learning capacity for tasks that need to synthesize…

Computation and Language · Computer Science 2018-04-17 Kevin Lin , Dianqi Li , Xiaodong He , Zhengyou Zhang , Ming-Ting Sun

We study two important concepts in adversarial deep learning---adversarial training and generative adversarial network (GAN). Adversarial training is the technique used to improve the robustness of discriminator by combining adversarial…

Machine Learning · Computer Science 2019-04-17 Xuanqing Liu , Cho-Jui Hsieh

Domain Adaptation is an actively researched problem in Computer Vision. In this work, we propose an approach that leverages unsupervised data to bring the source and target distributions closer in a learned joint feature space. We…

Computer Vision and Pattern Recognition · Computer Science 2018-04-16 Swami Sankaranarayanan , Yogesh Balaji , Carlos D. Castillo , Rama Chellappa

Drawing inspiration from the achievements of natural language processing, we adopt self-supervised learning and utilize an equivariant graph neural network to develop a unified platform designed for training generative models capable of…

Materials Science · Physics 2024-08-21 Fangze Liu , Zhantao Chen , Tianyi Liu , Ruyi Song , Yu Lin , Joshua J. Turner , Chunjing Jia

In recent years, Generative Adversarial Networks (GANs) have become a hot topic among researchers and engineers that work with deep learning. It has been a ground-breaking technique which can generate new pieces of content of data in a…

Computer Vision and Pattern Recognition · Computer Science 2022-07-25 Parthak Mehta , Sarthak Mishra , Nikhil Chouhan , Neel Pethani , Ishani Saha

We propose a new technique that boosts the convergence of training generative adversarial networks. Generally, the rate of training deep models reduces severely after multiple iterations. A key reason for this phenomenon is that a deep…

Machine Learning · Statistics 2018-06-15 Atsushi Nitanda , Taiji Suzuki

Neural Architecture Search (NAS) that aims to automate the procedure of architecture design has achieved promising results in many computer vision fields. In this paper, we propose an AdversarialNAS method specially tailored for Generative…

Computer Vision and Pattern Recognition · Computer Science 2020-04-09 Chen Gao , Yunpeng Chen , Si Liu , Zhenxiong Tan , Shuicheng Yan

Generative adversarial networks (GANs) provide an algorithmic framework for constructing generative models with several appealing properties: they do not require a likelihood function to be specified, only a generating procedure; they…

Machine Learning · Statistics 2017-02-28 Shakir Mohamed , Balaji Lakshminarayanan

Generative adversarial networks (GANs) are a hot research topic recently. GANs have been widely studied since 2014, and a large number of algorithms have been proposed. However, there is few comprehensive study explaining the connections…

Machine Learning · Computer Science 2020-01-22 Jie Gui , Zhenan Sun , Yonggang Wen , Dacheng Tao , Jieping Ye

The deep neural network (DNN) models for object detection using camera images are widely adopted in autonomous vehicles. However, DNN models are shown to be susceptible to adversarial image perturbations. In the existing methods of…

Robotics · Computer Science 2023-03-17 Hyung-Jin Yoon , Hamidreza Jafarnejadsani , Petros Voulgaris

A deep generative model such as a GAN learns to model a rich set of semantic and physical rules about the target distribution, but up to now, it has been obscure how such rules are encoded in the network, or how a rule could be changed. In…

Computer Vision and Pattern Recognition · Computer Science 2020-07-31 David Bau , Steven Liu , Tongzhou Wang , Jun-Yan Zhu , Antonio Torralba

Performance optimization of deep learning models is conducted either manually or through automatic architecture search, or a combination of both. On the other hand, their performance strongly depends on the target hardware and how…

Machine Learning · Computer Science 2022-09-23 Vahid Partovi Nia , Alireza Ghaffari , Mahdi Zolnouri , Yvon Savaria

A method for statistical parametric speech synthesis incorporating generative adversarial networks (GANs) is proposed. Although powerful deep neural networks (DNNs) techniques can be applied to artificially synthesize speech waveform, the…

Sound · Computer Science 2017-09-26 Yuki Saito , Shinnosuke Takamichi , Hiroshi Saruwatari