English
Related papers

Related papers: GPT-NAS: Evolutionary Neural Architecture Search w…

200 papers

Neural architecture search (NAS) has become increasingly popular in the deep learning community recently, mainly because it can provide an opportunity to allow interested users without rich expertise to benefit from the success of deep…

Machine Learning · Computer Science 2022-10-25 Shiqing Liu , Haoyu Zhang , Yaochu Jin

We propose Efficient Neural Architecture Search (ENAS), a fast and inexpensive approach for automatic model design. In ENAS, a controller learns to discover neural network architectures by searching for an optimal subgraph within a large…

Machine Learning · Computer Science 2018-02-13 Hieu Pham , Melody Y. Guan , Barret Zoph , Quoc V. Le , Jeff Dean

Current neural architecture search (NAS) algorithms still require expert knowledge and effort to design a search space for network construction. In this paper, we consider automating the search space design to minimize human interference,…

Computer Vision and Pattern Recognition · Computer Science 2021-03-23 Daquan Zhou , Xiaojie Jin , Xiaochen Lian , Linjie Yang , Yujing Xue , Qibin Hou , Jiashi Feng

Multi-task neural architecture search (NAS) enables transferring architectural knowledge among different tasks. However, ranking disorder between the source task and the target task degrades the architecture performance on the downstream…

Neural and Evolutionary Computing · Computer Science 2026-02-03 TingJie Zhang , HaiLin Liu

Existing Neural Architecture Search (NAS) methods either encode neural architectures using discrete encodings that do not scale well, or adopt supervised learning-based methods to jointly learn architecture representations and optimize…

Computer Vision and Pattern Recognition · Computer Science 2020-10-27 Shen Yan , Yu Zheng , Wei Ao , Xiao Zeng , Mi Zhang

The hyper-parameters of a neural network are traditionally designed through a time consuming process of trial and error that requires substantial expert knowledge. Neural Architecture Search (NAS) algorithms aim to take the human out of the…

Neural and Evolutionary Computing · Computer Science 2021-06-01 Andrew Nader , Danielle Azar

Neural architecture search (NAS) has been proposed to automatically tune deep neural networks, but existing search algorithms, e.g., NASNet, PNAS, usually suffer from expensive computational cost. Network morphism, which keeps the…

Machine Learning · Computer Science 2019-03-27 Haifeng Jin , Qingquan Song , Xia Hu

Neural Architecture Search has achieved state-of-the-art performance in a variety of tasks, out-performing human-designed networks. However, many assumptions, that require human definition, related with the problems being solved or the…

Machine Learning · Computer Science 2020-08-03 Vasco Lopes , Luís A. Alexandre

Neural Architecture Search (NAS) is a powerful technique for discovering high-performing CNN architectures, but most existing methods rely on costly training or extensive sampling. Zero-shot NAS offers a training-free alternative by using…

Machine Learning · Computer Science 2025-05-27 Ye Qiao , Jingcheng Li , Haocheng Xu , Sitao Huang

In this paper, we propose Broad Neural Architecture Search (BNAS) where we elaborately design broad scalable architecture dubbed Broad Convolutional Neural Network (BCNN) to solve the above issue. On one hand, the proposed broad scalable…

Machine Learning · Statistics 2021-03-17 Zixiang Ding , Yaran Chen , Nannan Li , Dongbin Zhao , Zhiquan Sun , C. L. Philip Chen

Neural Architecture Search (NAS) has gained widespread attention for its transformative potential in deep learning model design. However, the vast and complex search space of NAS leads to significant computational and time costs. Neural…

Neural and Evolutionary Computing · Computer Science 2025-09-30 Bingye Zhou , Caiyang Yu , Chenwei Tang

In this work, we propose a novel evolutionary algorithm for neural architecture search, applicable to global search spaces. The algorithm's architectural representation organizes the topology in multiple hierarchical modules, while the…

Neural and Evolutionary Computing · Computer Science 2023-05-05 Aristeidis Christoforidis , George Kyriakides , Konstantinos Margaritis

One-Shot Neural architecture search (NAS) attracts broad attention recently due to its capacity to reduce the computational hours through weight sharing. However, extensive experiments on several recent works show that there is no positive…

Machine Learning · Computer Science 2019-07-23 Miao Zhang , Huiqi Li , Shirui Pan , Taoping Liu , Steven Su

Data-driven, automatic design space exploration of neural accelerator architecture is desirable for specialization and productivity. Previous frameworks focus on sizing the numerical architectural hyper-parameters while neglect searching…

Machine Learning · Computer Science 2021-05-28 Yujun Lin , Mengtian Yang , Song Han

Recently, Neural Architecture Search has achieved great success in large-scale image classification. In contrast, there have been limited works focusing on architecture search for object detection, mainly because the costly ImageNet…

Computer Vision and Pattern Recognition · Computer Science 2019-09-06 Junran Peng , Ming Sun , Zhaoxiang Zhang , Tieniu Tan , Junjie Yan

Network architecture search (NAS) achieves state-of-the-art results in various tasks such as classification and semantic segmentation. Recently, a reinforcement learning-based approach has been proposed for Generative Adversarial Networks…

Computer Vision and Pattern Recognition · Computer Science 2021-01-01 Sivan Doveh , Raja Giryes

Neural Architecture Search (NAS) methods have shown to output networks that largely outperform human-designed networks. However, conventional NAS methods have mostly tackled the single dataset scenario, incuring in a large computational…

Computer Vision and Pattern Recognition · Computer Science 2024-05-14 Sofia Casarin , Oswald Lanz , Sergio Escalera

Neural Architecture Search (NAS) methods have been growing in popularity. These techniques have been fundamental to automate and speed up the time consuming and error-prone process of synthesizing novel Deep Learning (DL) architectures. NAS…

Machine Learning · Computer Science 2021-01-26 Hadjer Benmeziane , Kaoutar El Maghraoui , Hamza Ouarnoughi , Smail Niar , Martin Wistuba , Naigang Wang

Neural architecture search (NAS) has brought significant progress in recent image recognition tasks. Most existing NAS methods apply restricted search spaces, which limits the upper-bound performance of searched models. To address this…

Machine Learning · Computer Science 2022-12-06 Zimian Wei , Hengyue Pan , Lujun Li , Menglong Lu , Xin Niu , Peijie Dong , Dongsheng Li

Recently, the expert-crafted neural architectures is increasing overtaken by the utilization of neural architecture search (NAS) and automatic generation (and tuning) of network structures which has a close relation to the Hyperparameter…

Computer Vision and Pattern Recognition · Computer Science 2023-07-19 Seyed Mahdi Shariatzadeh , Mahmood Fathy , Reza Berangi , Mohammad Shahverdy