English
Related papers

Related papers: Optimizing Neural Architecture Search using Limite…

200 papers

Convolutional neural network (CNN) architectures have traditionally been explored by human experts in a manual search process that is time-consuming and ineffectively explores the massive space of potential solutions. Neural architecture…

Neural and Evolutionary Computing · Computer Science 2019-04-02 Gerard Jacques van Wyk , Anna Sergeevna Bosman

We explore efficient neural architecture search methods and show that a simple yet powerful evolutionary algorithm can discover new architectures with excellent performance. Our approach combines a novel hierarchical genetic representation…

Machine Learning · Computer Science 2018-02-26 Hanxiao Liu , Karen Simonyan , Oriol Vinyals , Chrisantha Fernando , Koray Kavukcuoglu

The evolutionary paradigm has been successfully applied to neural network search(NAS) in recent years. Due to the vast search complexity of the global space, current research mainly seeks to repeatedly stack partial architectures to build…

Neural and Evolutionary Computing · Computer Science 2024-03-06 Juan Zou , Weiwei Jiang , Yizhang Xia , Yuan Liu , Zhanglu Hou

Searching techniques in most of existing neural architecture search (NAS) algorithms are mainly dominated by differentiable methods for the efficiency reason. In contrast, we develop an efficient continuous evolutionary approach for…

Computer Vision and Pattern Recognition · Computer Science 2020-03-10 Zhaohui Yang , Yunhe Wang , Xinghao Chen , Boxin Shi , Chao Xu , Chunjing Xu , Qi Tian , Chang Xu

Neural Architecture Search (NAS) is emerging as a new research direction which has the potential to replace the hand-crafted neural architectures designed for specific tasks. Previous evolution based architecture search requires high…

Neural and Evolutionary Computing · Computer Science 2020-12-24 Nilotpal Sinha , Kuan-Wen Chen

Conventional neural architecture search (NAS) approaches are based on reinforcement learning or evolutionary strategy, which take more than 3000 GPU hours to find a good model on CIFAR-10. We propose an efficient NAS approach learning to…

Computer Vision and Pattern Recognition · Computer Science 2019-10-17 Xuanyi Dong , Yi Yang

Neural Architecture Search (NAS) has been explosively studied to automate the discovery of top-performer neural networks. Current works require heavy training of supernet or intensive architecture evaluations, thus suffering from heavy…

Computer Vision and Pattern Recognition · Computer Science 2021-03-17 Wuyang Chen , Xinyu Gong , Zhangyang Wang

Latest algorithms for automatic neural architecture search perform remarkable but are basically directionless in search space and computational expensive in training of every intermediate architecture. In this paper, we propose a method for…

Neural and Evolutionary Computing · Computer Science 2019-08-28 Hui Zhu , Zhulin An , Chuanguang Yang , Kaiqiang Xu , Erhu Zhao , Yongjun Xu

In recent years, the CNN architectures designed by evolution algorithms have proven to be competitive with handcrafted architectures designed by experts. However, these algorithms need a lot of computational power, which is beyond the…

Computer Vision and Pattern Recognition · Computer Science 2023-05-08 Ousmane Youme , Jean Marie Dembele , Eugene C. Ezin , Christophe Cambier

Evolution-based neural architecture search requires high computational resources, resulting in long search time. In this work, we propose a framework of applying the Covariance Matrix Adaptation Evolution Strategy (CMA-ES) to the neural…

Neural and Evolutionary Computing · Computer Science 2021-07-16 Nilotpal Sinha , Kuan-Wen Chen

Neural Architecture Search (NAS) has emerged as one of the effective methods to design the optimal neural network architecture automatically. Although neural architectures have achieved human-level performances in several tasks, few of them…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Caiyang Yu , Xianggen Liu , Yifan Wang , Yun Liu , Wentao Feng , Deng Xiong , Chenwei Tang , Jiancheng Lv

Neural architecture search (NAS) is a hot topic in the field of automated machine learning and outperforms humans in designing neural architectures on quite a few machine learning tasks. Motivated by the natural representation form of…

Neural and Evolutionary Computing · Computer Science 2021-09-30 Xuan Wu , Linhan Jia , Xiuyi Zhang , Liang Chen , Yanchun Liang , You Zhou , Chunguo Wu

Neural Architecture Search (NAS) has demonstrated state-of-the-art performance on various computer vision tasks. Despite the superior performance achieved, the efficiency and generality of existing methods are highly valued due to their…

Computer Vision and Pattern Recognition · Computer Science 2023-03-13 Xiawu Zheng , Chenyi Yang , Shaokun Zhang , Yan Wang , Baochang Zhang , Yongjian Wu , Yunsheng Wu , Ling Shao , Rongrong Ji

Neural Architecture Search (NAS) methods have been successfully applied to image tasks with excellent results. However, NAS methods are often complex and tend to converge to local minima as soon as generated architectures seem to yield good…

Machine Learning · Computer Science 2021-10-29 Vasco Lopes , Miguel Santos , Bruno Degardin , Luís A. Alexandre

Convolutional neural networks (CNNs) are effective at solving difficult problems like visual recognition, speech recognition and natural language processing. However, performance gain comes at the cost of laborious trial-and-error in…

Neural and Evolutionary Computing · Computer Science 2018-12-20 Yiheng Zhu , Yichen Yao , Zili Wu , Yujie Chen , Guozheng Li , Haoyuan Hu , Yinghui Xu

Neural Architecture Search (NAS) methods have been successfully applied to image tasks with excellent results. However, NAS methods are often complex and tend to converge to local minima as soon as generated architectures seem to yield good…

Neural and Evolutionary Computing · Computer Science 2022-08-16 Vasco Lopes , Miguel Santos , Bruno Degardin , Luís A. Alexandre

There is a growing interest in automated neural architecture search (NAS) methods. They are employed to routinely deliver high-quality neural network architectures for various challenging data sets and reduce the designer's effort. The NAS…

Neural and Evolutionary Computing · Computer Science 2022-06-28 Michal Pinos , Vojtech Mrazek , Lukas Sekanina

Automatic search of neural network architectures is a standing research topic. In addition to the fact that it presents a faster alternative to hand-designed architectures, it can improve their efficiency and for instance generate…

Computer Vision and Pattern Recognition · Computer Science 2019-02-06 Guillaume Michel , Mohammed Amine Alaoui , Alice Lebois , Amal Feriani , Mehdi Felhi

Automatic methods for Neural Architecture Search (NAS) have been shown to produce state-of-the-art network models. Yet, their main drawback is the computational complexity of the search process. As some primal methods optimized over a…

Machine Learning · Statistics 2019-10-11 Asaf Noy , Niv Nayman , Tal Ridnik , Nadav Zamir , Sivan Doveh , Itamar Friedman , Raja Giryes , Lihi Zelnik-Manor

The goals of this research were to search for Convolutional Neural Network (CNN) architectures, suitable for an on-device processor with limited computing resources, performing at substantially lower Network Architecture Search (NAS) costs.…

Computer Vision and Pattern Recognition · Computer Science 2021-09-01 Chakkrit Termritthikun , Yeshi Jamtsho , Jirarat Ieamsaard , Paisarn Muneesawang , Ivan Lee
‹ Prev 1 2 3 10 Next ›