English
Related papers

Related papers: ImmuNetNAS: An Immune-network approach for searchi…

200 papers

The use of automatic methods, often referred to as Neural Architecture Search (NAS), in designing neural network architectures has recently drawn considerable attention. In this work, we present an efficient NAS approach, named HM- NAS,…

Machine Learning · Computer Science 2019-09-10 Shen Yan , Biyi Fang , Faen Zhang , Yu Zheng , Xiao Zeng , Hui Xu , Mi Zhang

Neural architecture search (NAS) has achieved remarkable results in deep neural network design. Differentiable architecture search converts the search over discrete architectures into a hyperparameter optimization problem which can be…

Recent studies on neural architecture search have shown that automatically designed neural networks perform as good as expert-crafted architectures. While most existing works aim at finding architectures that optimize the prediction…

Hardware-Aware Neural Architecture Search (HW-NAS) requires joint optimization of accuracy and latency under device constraints. Traditional supernet-based methods require multiple GPU days per dataset. Large Language Model (LLM)-driven…

Machine Learning · Computer Science 2025-12-08 Hengyi Zhu , Grace Li Zhang , Shaoyi Huang

Neural architecture search (NAS) aims to discover network architectures with desired properties such as high accuracy or low latency. Recently, differentiable NAS (DNAS) has demonstrated promising results while maintaining a search cost…

Machine Learning · Computer Science 2020-08-31 Arash Vahdat , Arun Mallya , Ming-Yu Liu , Jan Kautz

Neural architecture search (NAS) is a hot topic in the field of automated machine learning and outperforms humans in designing neural architectures on quite a few machine learning tasks. Motivated by the natural representation form of…

Neural and Evolutionary Computing · Computer Science 2021-09-30 Xuan Wu , Linhan Jia , Xiuyi Zhang , Liang Chen , Yanchun Liang , You Zhou , Chunguo Wu

Recently, much attention has been spent on neural architecture search (NAS), aiming to outperform those manually-designed neural architectures on high-level vision recognition tasks. Inspired by the success, here we attempt to leverage NAS…

Computer Vision and Pattern Recognition · Computer Science 2021-10-12 Haokui Zhang , Ying Li , Hao Chen , Chengrong Gong , Zongwen Bai , Chunhua Shen

Neural Architecture Search (NAS) has received extensive attention due to its capability to discover neural network architectures in an automated manner. aw_nas is an open-source Python framework implementing various NAS algorithms in a…

Neural and Evolutionary Computing · Computer Science 2020-12-21 Xuefei Ning , Changcheng Tang , Wenshuo Li , Songyi Yang , Tianchen Zhao , Niansong Zhang , Tianyi Lu , Shuang Liang , Huazhong Yang , Yu Wang

Neural architecture search (NAS) has recently reshaped our understanding on various vision tasks. Similar to the success of NAS in high-level vision tasks, it is possible to find a memory and computationally efficient solution via NAS with…

Image and Video Processing · Electrical Eng. & Systems 2021-04-07 Qian Ning , Weisheng Dong , Xin Li , Jinjian Wu , Leida Li , Guangming Shi

Practical use of neural networks often involves requirements on latency, energy and memory among others. A popular approach to find networks under such requirements is through constrained Neural Architecture Search (NAS). However, previous…

Machine Learning · Computer Science 2022-04-28 Niv Nayman , Yonathan Aflalo , Asaf Noy , Rong Jin , Lihi Zelnik-Manor

Neural Architecture Search has achieved state-of-the-art performance in a variety of tasks, out-performing human-designed networks. However, many assumptions, that require human definition, related with the problems being solved or the…

Machine Learning · Computer Science 2020-08-03 Vasco Lopes , Luís A. Alexandre

Neural architecture search (NAS) is a promising research direction that has the potential to replace expert-designed networks with learned, task-specific architectures. In this work, in order to help ground the empirical results in this…

Machine Learning · Computer Science 2019-08-01 Liam Li , Ameet Talwalkar

Evolutionary neural architecture search (ENAS) has recently received increasing attention by effectively finding high-quality neural architectures, which however consumes high computational cost by training the architecture encoded by each…

Artificial Intelligence · Computer Science 2021-08-11 Shangshang Yang , Ye Tian , Xiaoshu Xiang , Shichen Peng , Xingyi Zhang

The term Neural Architecture Search (NAS) refers to the automatic optimization of network architectures for a new, previously unknown task. Since testing an architecture is computationally very expensive, many optimizers need days or even…

Machine Learning · Computer Science 2019-07-22 Martin Wistuba

Neural Architecture Search (NAS) is a research field concerned with utilizing optimization algorithms to design optimal neural network architectures. There are many approaches concerning the architectural search spaces, optimization…

Machine Learning · Computer Science 2020-05-25 George Kyriakides , Konstantinos Margaritis

Conventional Neural Architecture Search (NAS) aims at finding a single architecture that achieves the best performance, which usually optimizes task related learning objectives such as accuracy. However, a single architecture may not be…

Machine Learning · Computer Science 2019-05-24 An-Chieh Cheng , Chieh Hubert Lin , Da-Cheng Juan , Wei Wei , Min Sun

Neural Architecture Search (NAS) provides state-of-the-art results when trained on well-curated datasets with annotated labels. However, annotating data or even having balanced number of samples can be a luxury for practitioners from…

Computer Vision and Pattern Recognition · Computer Science 2021-09-21 Aleksandr Timofeev , Grigorios G. Chrysos , Volkan Cevher

One-Shot Neural architecture search (NAS) attracts broad attention recently due to its capacity to reduce the computational hours through weight sharing. However, extensive experiments on several recent works show that there is no positive…

Machine Learning · Computer Science 2019-07-23 Miao Zhang , Huiqi Li , Shirui Pan , Taoping Liu , Steven Su

Time-intensive performance evaluations significantly impede progress in Neural Architecture Search (NAS). To address this, neural predictors leverage surrogate models trained on proxy datasets, allowing for direct performance predictions…

Machine Learning · Computer Science 2025-09-24 Jindi Lv , Yuhao Zhou , Yuxin Tian , Qing Ye , Wentao Feng , Jiancheng Lv

Neural architecture search (NAS) has gained increasing attention in the community of architecture design. One of the key factors behind the success lies in the training efficiency created by the weight sharing (WS) technique. However,…

Computer Vision and Pattern Recognition · Computer Science 2020-03-31 Shuaicheng Niu , Jiaxiang Wu , Yifan Zhang , Yong Guo , Peilin Zhao , Junzhou Huang , Mingkui Tan