English
Related papers

Related papers: Ecological Neural Architecture Search

200 papers

Neural Architecture Search (NAS) has gained widespread attention for its transformative potential in deep learning model design. However, the vast and complex search space of NAS leads to significant computational and time costs. Neural…

Neural and Evolutionary Computing · Computer Science 2025-09-30 Bingye Zhou , Caiyang Yu , Chenwei Tang

There is a growing interest in automated neural architecture search (NAS) methods. They are employed to routinely deliver high-quality neural network architectures for various challenging data sets and reduce the designer's effort. The NAS…

Neural and Evolutionary Computing · Computer Science 2022-06-28 Michal Pinos , Vojtech Mrazek , Lukas Sekanina

Neural Architecture Search (NAS) is an important yet challenging task in network design due to its high computational consumption. To address this issue, we propose the Reinforced Evolutionary Neural Architecture Search (RE- NAS), which is…

Neural and Evolutionary Computing · Computer Science 2019-04-11 Yukang Chen , Gaofeng Meng , Qian Zhang , Shiming Xiang , Chang Huang , Lisen Mu , Xinggang Wang

Automated machine learning (AutoML) has seen a resurgence in interest with the boom of deep learning over the past decade. In particular, Neural Architecture Search (NAS) has seen significant attention throughout the AutoML research…

Neural and Evolutionary Computing · Computer Science 2020-09-23 Min Shi , David A. Wilson , Xingquan Zhu , Yu Huang , Yuan Zhuang , Jianxun Liu , Yufei Tang

Efficient Natural Evolution Strategies (eNES) is a novel alternative to conventional evolutionary algorithms, using the natural gradient to adapt the mutation distribution. Unlike previous methods based on natural gradients, eNES uses a…

Artificial Intelligence · Computer Science 2012-09-27 Yi Sun , Daan Wierstra , Tom Schaul , Juergen Schmidhuber

The effectiveness of Evolutionary Neural Architecture Search (ENAS) is influenced by the design of the search space. Nevertheless, common methods including the global search space, scalable search space and hierarchical search space have…

Neural and Evolutionary Computing · Computer Science 2024-03-13 Juan Zou , Han Chu , Yizhang Xia , Junwen Xu , Yuan Liu , Zhanglu Hou

This work presents a novel approach to neural architecture search (NAS) that aims to reduce energy costs and increase carbon efficiency during the model design process. The proposed framework, called carbon-efficient NAS (CE-NAS), consists…

Machine Learning · Computer Science 2023-07-12 Yiyang Zhao , Tian Guo

Neural Architecture Search has achieved state-of-the-art performance in a variety of tasks, out-performing human-designed networks. However, many assumptions, that require human definition, related with the problems being solved or the…

Machine Learning · Computer Science 2020-08-03 Vasco Lopes , Luís A. Alexandre

Convolutional Neural Networks (CNNs) continue to achieve great success in classification tasks as innovative techniques and complex multi-path architecture topologies are introduced. Neural Architecture Search (NAS) aims to automate the…

Neural and Evolutionary Computing · Computer Science 2023-12-14 Trevor Londt , Xiaoying Gao , Peter Andreae , Yi Mei

We propose Stochastic Neural Architecture Search (SNAS), an economical end-to-end solution to Neural Architecture Search (NAS) that trains neural operation parameters and architecture distribution parameters in same round of…

Machine Learning · Computer Science 2020-04-02 Sirui Xie , Hehui Zheng , Chunxiao Liu , Liang Lin

Neural Architecture Search (NAS), i.e., the automation of neural network design, has gained much popularity in recent years with increasingly complex search algorithms being proposed. Yet, solid comparisons with simple baselines are often…

Neural and Evolutionary Computing · Computer Science 2020-07-28 T. Den Ottelander , A. Dushatskiy , M. Virgolin , P. A. N. Bosman

Neural Architecture Search (NAS) is quickly becoming the go-to approach to optimize the structure of Deep Learning (DL) models for complex tasks such as Image Classification or Object Detection. However, many other relevant applications of…

Neuroevolution has greatly promoted Deep Neural Network (DNN) architecture design and its applications, while there is a lack of methods available across different DNN types concerning both their scale and performance. In this study, we…

Neural and Evolutionary Computing · Computer Science 2023-02-03 Zhenhao Shuai , Hongbo Liu , Zhaolin Wan , Wei-Jie Yu , Jun Zhang

In this work, we propose a novel evolutionary algorithm for neural architecture search, applicable to global search spaces. The algorithm's architectural representation organizes the topology in multiple hierarchical modules, while the…

Neural and Evolutionary Computing · Computer Science 2023-05-05 Aristeidis Christoforidis , George Kyriakides , Konstantinos Margaritis

Neural Architecture Search (NAS) aims to optimize deep neural networks' architecture for better accuracy or smaller computational cost and has recently gained more research interests. Despite various successful approaches proposed to solve…

Machine Learning · Computer Science 2020-11-03 Bas van Stein , Hao Wang , Thomas Bäck

Mobile and edge computing devices for always-on classification tasks require energy-efficient neural network architectures. In this paper we present several changes to neural architecture searches (NAS) that improve the chance of success in…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-02 Daniel T. Speckhard , Karolis Misiunas , Sagi Perel , Tenghui Zhu , Simon Carlile , Malcolm Slaney

Neural Architecture Search (NAS) continues to serve a key roll in the design and development of neural networks for task specific deployment. Modern NAS techniques struggle to deal with ever increasing search space complexity and compute…

Computer Vision and Pattern Recognition · Computer Science 2024-11-25 Arjun Sridhar , Yiran Chen

Neural network architectures found by sophistic search algorithms achieve strikingly good test performance, surpassing most human-crafted network models by significant margins. Although computationally efficient, their design is often very…

Machine Learning · Computer Science 2021-04-23 Kevin Alexander Laube , Andreas Zell

Traditional neural architecture search (NAS) has a significant impact in computer vision by automatically designing network architectures for various tasks. In this paper, binarized neural architecture search (BNAS), with a search space of…

Computer Vision and Pattern Recognition · Computer Science 2020-09-10 Hanlin Chen , Li'an Zhuo , Baochang Zhang , Xiawu Zheng , Jianzhuang Liu , Rongrong Ji , David Doermann , Guodong Guo

Graph neural architecture search (GNAS) can customize high-performance graph neural network architectures for specific graph tasks or datasets. However, existing GNAS methods begin searching for architectures from a zero-knowledge state,…

Neural and Evolutionary Computing · Computer Science 2024-11-27 Chao Wang , Jiaxuan Zhao , Lingling Li , Licheng Jiao , Fang Liu , Xu Liu , Shuyuan Yang