English
Related papers

Related papers: Guided Evolutionary Neural Architecture Search Wit…

200 papers

Neural Architecture Search (NAS) automates the design of high-performing neural networks but typically targets a single predefined task, thereby restricting its real-world applicability. To address this, Meta Neural Architecture Search…

Machine Learning · Computer Science 2025-08-14 Zijun Sun , Yanning Shen

Neural Architecture Search (NAS) continues to serve a key roll in the design and development of neural networks for task specific deployment. Modern NAS techniques struggle to deal with ever increasing search space complexity and compute…

Computer Vision and Pattern Recognition · Computer Science 2024-11-25 Arjun Sridhar , Yiran Chen

When employing an evolutionary algorithm to optimize a neural networks architecture, developers face the added challenge of tuning the evolutionary algorithm's own hyperparameters - population size, mutation rate, cloning rate, and number…

Neural and Evolutionary Computing · Computer Science 2025-03-17 Benjamin David Winter , William J. Teahan

Latest algorithms for automatic neural architecture search perform remarkable but are basically directionless in search space and computational expensive in training of every intermediate architecture. In this paper, we propose a method for…

Neural and Evolutionary Computing · Computer Science 2019-08-28 Hui Zhu , Zhulin An , Chuanguang Yang , Kaiqiang Xu , Erhu Zhao , Yongjun Xu

Searching techniques in most of existing neural architecture search (NAS) algorithms are mainly dominated by differentiable methods for the efficiency reason. In contrast, we develop an efficient continuous evolutionary approach for…

Computer Vision and Pattern Recognition · Computer Science 2020-03-10 Zhaohui Yang , Yunhe Wang , Xinghao Chen , Boxin Shi , Chao Xu , Chunjing Xu , Qi Tian , Chang Xu

An effective and efficient architecture performance evaluation scheme is essential for the success of Neural Architecture Search (NAS). To save computational cost, most of existing NAS algorithms often train and evaluate intermediate neural…

Machine Learning · Computer Science 2021-09-27 Yixing Xu , Yunhe Wang , Kai Han , Yehui Tang , Shangling Jui , Chunjing Xu , Chang Xu

The performance of a deep neural network is heavily dependent on its architecture and various neural architecture search strategies have been developed for automated network architecture design. Recently, evolutionary neural architecture…

Neural and Evolutionary Computing · Computer Science 2020-03-27 Haoyu Zhang , Yaochu Jin , Ran Cheng , Kuangrong Hao

The early pioneering Neural Architecture Search (NAS) works were multi-trial methods applicable to any general search space. The subsequent works took advantage of the early findings and developed weight-sharing methods that assume a…

Neural and Evolutionary Computing · Computer Science 2022-02-18 Hyunghun Cho , Jungwook Shin , Wonjong Rhee

The evolutionary paradigm has been successfully applied to neural network search(NAS) in recent years. Due to the vast search complexity of the global space, current research mainly seeks to repeatedly stack partial architectures to build…

Neural and Evolutionary Computing · Computer Science 2024-03-06 Juan Zou , Weiwei Jiang , Yizhang Xia , Yuan Liu , Zhanglu Hou

Neural Architecture Search (NAS) aims to automatically excavate the optimal network architecture with superior test performance. Recent neural architecture search (NAS) approaches rely on validation loss or accuracy to find the superior…

Computer Vision and Pattern Recognition · Computer Science 2023-05-19 Joonhyun Jeong , Joonsang Yu , Geondo Park , Dongyoon Han , YoungJoon Yoo

Graph neural architecture search (GNAS) can customize high-performance graph neural network architectures for specific graph tasks or datasets. However, existing GNAS methods begin searching for architectures from a zero-knowledge state,…

Neural and Evolutionary Computing · Computer Science 2024-11-27 Chao Wang , Jiaxuan Zhao , Lingling Li , Licheng Jiao , Fang Liu , Xu Liu , Shuyuan Yang

Neural architecture search (NAS) automates neural network design by using optimization algorithms to navigate architecture spaces, reducing the burden of manual architecture design. While NAS has achieved success, applying it to emerging…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Yisheng Yang , Guodong Du , Chean Khim Toa , Ho-Kin Tang , Sim Kuan Goh

Neural Architecture Search (NAS) is a collection of methods to craft the way neural networks are built. Current NAS methods are far from ab initio and automatic, as they use manual backbone architectures or micro building blocks (cells),…

Machine Learning · Computer Science 2020-10-20 Anubhav Garg , Amit Kumar Saha , Debo Dutta

Neural architecture search (NAS) is a challenging problem. Hierarchical search spaces allow for cheap evaluations of neural network sub modules to serve as surrogate for architecture evaluations. Yet, sometimes the hierarchy is too…

Neural and Evolutionary Computing · Computer Science 2024-04-26 Simon Neumeyer , Julian Stier , Michael Granitzer

Neural architecture search (NAS) aims to automatically design deep neural networks of satisfactory performance. Wherein, architecture performance predictor is critical to efficiently value an intermediate neural architecture. But for the…

Computer Vision and Pattern Recognition · Computer Science 2020-10-16 Yehui Tang , Yunhe Wang , Yixing Xu , Hanting Chen , Chunjing Xu , Boxin Shi , Chao Xu , Qi Tian , Chang Xu

Efficient identification of people and objects, segmentation of regions of interest and extraction of relevant data in images, texts, audios and videos are evolving considerably in these past years, which deep learning methods, combined…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Jeovane Honorio Alves , Lucas Ferrari de Oliveira

In neural architecture search, the structure of the neural network to best model a given dataset is determined by an automated search process. Efficient Neural Architecture Search (ENAS), proposed by Pham et al. (2018), has recently…

Machine Learning · Computer Science 2019-06-19 Prabhant Singh , Tobias Jacobs , Sebastien Nicolas , Mischa Schmidt

Evolutionary computation (EC)-based neural architecture search (NAS) has achieved remarkable performance in the automatic design of neural architectures. However, the high computational cost associated with evaluating searched architectures…

Neural and Evolutionary Computing · Computer Science 2025-05-01 Yangyang Li , Guanlong Liu , Ronghua Shang , Licheng Jiao

Neural Architecture Search (NAS) is an important yet challenging task in network design due to its high computational consumption. To address this issue, we propose the Reinforced Evolutionary Neural Architecture Search (RE- NAS), which is…

Neural and Evolutionary Computing · Computer Science 2019-04-11 Yukang Chen , Gaofeng Meng , Qian Zhang , Shiming Xiang , Chang Huang , Lisen Mu , Xinggang Wang

Neural Architecture Search (NAS) aims to facilitate the design of deep networks for new tasks. Existing techniques rely on two stages: searching over the architecture space and validating the best architecture. NAS algorithms are currently…

Machine Learning · Computer Science 2019-11-25 Kaicheng Yu , Christian Sciuto , Martin Jaggi , Claudiu Musat , Mathieu Salzmann