English
Related papers

Related papers: Guided Evolution for Neural Architecture Search

200 papers

Neural Architecture Search (NAS), i.e., the automation of neural network design, has gained much popularity in recent years with increasingly complex search algorithms being proposed. Yet, solid comparisons with simple baselines are often…

Neural and Evolutionary Computing · Computer Science 2020-07-28 T. Den Ottelander , A. Dushatskiy , M. Virgolin , P. A. N. Bosman

The time and effort involved in hand-designing deep neural networks is immense. This has prompted the development of Neural Architecture Search (NAS) techniques to automate this design. However, NAS algorithms tend to be slow and expensive;…

Machine Learning · Computer Science 2021-06-14 Joseph Mellor , Jack Turner , Amos Storkey , Elliot J. Crowley

Neural Architecture Search (NAS) has shown excellent results in designing architectures for computer vision problems. NAS alleviates the need for human-defined settings by automating architecture design and engineering. However, NAS methods…

Machine Learning · Computer Science 2021-10-29 Vasco Lopes , Saeid Alirezazadeh , Luís A. Alexandre

Deep learning has made breakthroughs and substantial in many fields due to its powerful automatic representation capabilities. It has been proven that neural architecture design is crucial to the feature representation of data and the final…

Machine Learning · Computer Science 2021-03-03 Pengzhen Ren , Yun Xiao , Xiaojun Chang , Po-Yao Huang , Zhihui Li , Xiaojiang Chen , Xin Wang

Neural Architecture Search (NAS) aims to automatically excavate the optimal network architecture with superior test performance. Recent neural architecture search (NAS) approaches rely on validation loss or accuracy to find the superior…

Computer Vision and Pattern Recognition · Computer Science 2023-05-19 Joonhyun Jeong , Joonsang Yu , Geondo Park , Dongyoon Han , YoungJoon Yoo

Neural architecture search (NAS) automates neural network design by using optimization algorithms to navigate architecture spaces, reducing the burden of manual architecture design. While NAS has achieved success, applying it to emerging…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Yisheng Yang , Guodong Du , Chean Khim Toa , Ho-Kin Tang , Sim Kuan Goh

Neural Architecture Search (NAS) achieves significant progress in many computer vision tasks. While many methods have been proposed to improve the efficiency of NAS, the search progress is still laborious because training and evaluating…

Computer Vision and Pattern Recognition · Computer Science 2020-02-28 Dongzhan Zhou , Xinchi Zhou , Wenwei Zhang , Chen Change Loy , Shuai Yi , Xuesen Zhang , Wanli Ouyang

Automated machine learning (AutoML) has seen a resurgence in interest with the boom of deep learning over the past decade. In particular, Neural Architecture Search (NAS) has seen significant attention throughout the AutoML research…

Neural and Evolutionary Computing · Computer Science 2020-09-23 Min Shi , David A. Wilson , Xingquan Zhu , Yu Huang , Yuan Zhuang , Jianxun Liu , Yufei Tang

Recent advances in Neural Architecture Search (NAS) such as one-shot NAS offer the ability to extract specialized hardware-aware sub-network configurations from a task-specific super-network. While considerable effort has been employed…

Machine Learning · Computer Science 2022-05-24 Daniel Cummings , Anthony Sarah , Sharath Nittur Sridhar , Maciej Szankin , Juan Pablo Munoz , Sairam Sundaresan

The automation of neural architecture design has been a coveted alternative to human experts. Recent works have small search space, which is easier to optimize but has a limited upper bound of the optimal solution. Extra human design is…

Computer Vision and Pattern Recognition · Computer Science 2021-08-19 Yuanzheng Ci , Chen Lin , Ming Sun , Boyu Chen , Hongwen Zhang , Wanli Ouyang

In recent years, neural architecture search (NAS) methods have been proposed for the automatic generation of task-oriented network architecture in image classification. However, the architectures obtained by existing NAS approaches are…

Computer Vision and Pattern Recognition · Computer Science 2021-03-24 Haichao Zhang , Kuangrong Hao , Lei Gao , Xuesong Tang , Bing Wei

Many evolutionary algorithms (EAs) take advantage of parallel evaluation of candidates. However, if evaluation times vary significantly, many worker nodes (i.e.,\ compute clients) are idle much of the time, waiting for the next generation…

Neural and Evolutionary Computing · Computer Science 2024-01-02 Jason Liang , Hormoz Shahrzad , Risto Miikkulainen

Neural Architecture Search (NAS) aims to optimize deep neural networks' architecture for better accuracy or smaller computational cost and has recently gained more research interests. Despite various successful approaches proposed to solve…

Machine Learning · Computer Science 2020-11-03 Bas van Stein , Hao Wang , Thomas Bäck

Neural Architecture Search (NAS) has become a pivotal technique in automated machine learning. Evolutionary Algorithm (EA)-based methods demonstrate superior search quality but suffer from prohibitive computational costs, while…

Neural and Evolutionary Computing · Computer Science 2026-04-02 Xingbang Du , Enzhi Zhang , Rui Zhong , Yang Cao , Masaharu Munetomo

To achieve excellent performance with modern neural networks, having the right network architecture is important. Neural Architecture Search (NAS) concerns the automatic discovery of task-specific network architectures. Modern NAS…

Computer Vision and Pattern Recognition · Computer Science 2022-04-29 Alexander Chebykin , Tanja Alderliesten , Peter A. N. Bosman

When employing an evolutionary algorithm to optimize a neural networks architecture, developers face the added challenge of tuning the evolutionary algorithm's own hyperparameters - population size, mutation rate, cloning rate, and number…

Neural and Evolutionary Computing · Computer Science 2025-03-17 Benjamin David Winter , William J. Teahan

Neural Architecture Search (NAS) has been explosively studied to automate the discovery of top-performer neural networks. Current works require heavy training of supernet or intensive architecture evaluations, thus suffering from heavy…

Computer Vision and Pattern Recognition · Computer Science 2021-03-17 Wuyang Chen , Xinyu Gong , Zhangyang Wang

Neural structure search (NAS), as the mainstream approach to automate deep neural architecture design, has achieved much success in recent years. However, the performance estimation component adhering to NAS is often prohibitively costly,…

Machine Learning · Computer Science 2022-04-27 Zixuan Liang , Yanan Sun

Neural Architecture Search (NAS) has been quite successful in constructing state-of-the-art models on a variety of tasks. Unfortunately, the computational cost can make it difficult to scale. In this paper, we make the first attempt to…

Machine Learning · Computer Science 2019-11-18 Albert Shaw , Wei Wei , Weiyang Liu , Le Song , Bo Dai

Performing analytical tasks over graph data has become increasingly interesting due to the ubiquity and large availability of relational information. However, unlike images or sentences, there is no notion of sequence in networks. Nodes…

Neural and Evolutionary Computing · Computer Science 2020-10-28 Matheus Nunes , Gisele L. Pappa