中文
相关论文

相关论文: Generative Adversarial Neural Architecture Search

200 篇论文

Neural architecture search (NAS) is a hard computationally expensive optimization problem with a discrete, vast, and spiky search space. One of the key research efforts dedicated to this space focuses on accelerating NAS via certain proxy…

机器学习 · 计算机科学 2025-09-09 Bo Lyu , Yu Cui , Tuo Shi , Ke Li

Neural Architecture Search (NAS) aims to automatically find effective architectures within a predefined search space. However, the search space is often extremely large. As a result, directly searching in such a large search space is…

计算机视觉与模式识别 · 计算机科学 2024-06-07 Yaofo Chen , Yong Guo , Daihai Liao , Fanbing Lv , Hengjie Song , James Tin-Yau Kwok , Mingkui Tan

Generative adversarial networks (GANs) are powerful generative models, but usually suffer from instability and generalization problem which may lead to poor generations. Most existing works focus on stabilizing the training of the…

机器学习 · 计算机科学 2020-04-29 Shufei Zhang , Zhuang Qian , Kaizhu Huang , Jimin Xiao , Yuan He

Neural Architecture Search (NAS) often trains and evaluates a large number of architectures. Recent predictor-based NAS approaches attempt to alleviate such heavy computation costs with two key steps: sampling some architecture-performance…

机器学习 · 计算机科学 2021-11-04 Junru Wu , Xiyang Dai , Dongdong Chen , Yinpeng Chen , Mengchen Liu , Ye Yu , Zhangyang Wang , Zicheng Liu , Mei Chen , Lu Yuan

A fundamental question lies in almost every application of deep neural networks: what is the optimal neural architecture given a specific dataset? Recently, several Neural Architecture Search (NAS) frameworks have been developed that use…

分布式、并行与集群计算 · 计算机科学 2019-02-04 Weiwen Jiang , Xinyi Zhang , Edwin H. -M. Sha , Lei Yang , Qingfeng Zhuge , Yiyu Shi , Jingtong Hu

Evolutionary computation (EC)-based neural architecture search (NAS) has achieved remarkable performance in the automatic design of neural architectures. However, the high computational cost associated with evaluating searched architectures…

神经与进化计算 · 计算机科学 2025-05-01 Yangyang Li , Guanlong Liu , Ronghua Shang , Licheng Jiao

Generative Adversarial Networks (GANs) have proven to be a powerful framework for learning to draw samples from complex distributions. However, GANs are also notoriously difficult to train, with mode collapse and oscillations a common…

机器学习 · 统计学 2018-11-28 Kevin J Liang , Chunyuan Li , Guoyin Wang , Lawrence Carin

Neural architecture search (NAS) is a hot topic in the field of automated machine learning and outperforms humans in designing neural architectures on quite a few machine learning tasks. Motivated by the natural representation form of…

神经与进化计算 · 计算机科学 2021-09-30 Xuan Wu , Linhan Jia , Xiuyi Zhang , Liang Chen , Yanchun Liang , You Zhou , Chunguo Wu

Neural architecture search (NAS) has a great impact by automatically designing effective neural network architectures. However, the prohibitive computational demand of conventional NAS algorithms (e.g. $10^4$ GPU hours) makes it difficult…

机器学习 · 计算机科学 2019-02-26 Han Cai , Ligeng Zhu , Song Han

Neural Architecture Search (NAS) has demonstrated state-of-the-art performance on various computer vision tasks. Despite the superior performance achieved, the efficiency and generality of existing methods are highly valued due to their…

计算机视觉与模式识别 · 计算机科学 2023-03-13 Xiawu Zheng , Chenyi Yang , Shaokun Zhang , Yan Wang , Baochang Zhang , Yongjian Wu , Yunsheng Wu , Ling Shao , Rongrong Ji

Neural architecture search (NAS) aims to automate architecture design processes and improve the performance of deep neural networks. Platform-aware NAS methods consider both performance and complexity and can find well-performing…

神经与进化计算 · 计算机科学 2022-07-22 Yuhei Noda , Shota Saito , Shinichi Shirakawa

In the past few years, Differentiable Neural Architecture Search (DNAS) rapidly imposed itself as the trending approach to automate the discovery of deep neural network architectures. This rise is mainly due to the popularity of DARTS, one…

机器学习 · 计算机科学 2023-05-02 Alexandre Heuillet , Ahmad Nasser , Hichem Arioui , Hedi Tabia

Convolutional neural networks (CNNs) are effective at solving difficult problems like visual recognition, speech recognition and natural language processing. However, performance gain comes at the cost of laborious trial-and-error in…

神经与进化计算 · 计算机科学 2018-12-20 Yiheng Zhu , Yichen Yao , Zili Wu , Yujie Chen , Guozheng Li , Haoyuan Hu , Yinghui Xu

Artificial neural network (NN) architecture design is a nontrivial and time-consuming task that often requires a high level of human expertise. Neural architecture search (NAS) serves to automate the design of NN architectures and has…

神经与进化计算 · 计算机科学 2024-09-10 Reinhard Booysen , Anna Sergeevna Bosman

With the popularity of deep learning, the hardware implementation platform of deep learning has received increasing interest. Unlike the general purpose devices, e.g., CPU, or GPU, where the deep learning algorithms are executed at the…

机器学习 · 计算机科学 2022-11-22 Lang Feng , Wenjian Liu , Chuliang Guo , Ke Tang , Cheng Zhuo , Zhongfeng Wang

Neural architecture search (NAS) is a recent methodology for automating the design of neural network architectures. Differentiable neural architecture search (DARTS) is a promising NAS approach that dramatically increases search efficiency.…

机器学习 · 计算机科学 2021-04-22 Erik Bodin , Federico Tomasi , Zhenwen Dai

Automated machine learning (AutoML) has seen a resurgence in interest with the boom of deep learning over the past decade. In particular, Neural Architecture Search (NAS) has seen significant attention throughout the AutoML research…

神经与进化计算 · 计算机科学 2020-09-23 Min Shi , David A. Wilson , Xingquan Zhu , Yu Huang , Yuan Zhuang , Jianxun Liu , Yufei Tang

We introduce a novel approach for sequence decoding, Discriminative Adversarial Search (DAS), which has the desirable properties of alleviating the effects of exposure bias without requiring external metrics. Inspired by Generative…

计算与语言 · 计算机科学 2020-09-01 Thomas Scialom , Paul-Alexis Dray , Sylvain Lamprier , Benjamin Piwowarski , Jacopo Staiano

Generative adversarial networks (GANs) are a powerful approach to unsupervised learning. They have achieved state-of-the-art performance in the image domain. However, GANs are limited in two ways. They often learn distributions with low…

机器学习 · 统计学 2019-10-11 Adji B. Dieng , Francisco J. R. Ruiz , David M. Blei , Michalis K. Titsias

Automating the research for the best neural network model is a task that has gained more and more relevance in the last few years. In this context, Neural Architecture Search (NAS) represents the most effective technique whose results rival…

机器学习 · 计算机科学 2022-10-07 Andrea Falanti , Eugenio Lomurno , Stefano Samele , Danilo Ardagna , Matteo Matteucci