中文
相关论文

相关论文: Stage-Wise Neural Architecture Search

200 篇论文

Neural architecture search (NAS) methods have been proposed to release human experts from tedious architecture engineering. However, most current methods are constrained in small-scale search due to the issue of computational resources.…

计算机视觉与模式识别 · 计算机科学 2019-03-26 Jiemin Fang , Yukang Chen , Xinbang Zhang , Qian Zhang , Chang Huang , Gaofeng Meng , Wenyu Liu , Xinggang Wang

Most existing neural architecture search (NAS) algorithms are dedicated to and evaluated by the downstream tasks, e.g., image classification in computer vision. However, extensive experiments have shown that, prominent neural architectures,…

机器学习 · 计算机科学 2021-11-18 Yuhong Li , Cong Hao , Pan Li , Jinjun Xiong , Deming Chen

Despite the success of recent Neural Architecture Search (NAS) methods on various tasks which have shown to output networks that largely outperform human-designed networks, conventional NAS methods have mostly tackled the optimization of…

机器学习 · 计算机科学 2021-07-05 Hayeon Lee , Eunyoung Hyung , Sung Ju Hwang

Deep convolutional neural networks (CNNs) have been widely used in surface defect detection. However, no CNN architecture is suitable for all detection tasks and designing effective task-specific requires considerable effort. The neural…

计算机视觉与模式识别 · 计算机科学 2023-11-21 Zhenrong Wang , Bin Li , Weifeng Li , Shuanlong Niu , Wang Miao , Tongzhi Niu

Neural Architecture Search (NAS) has been a source of dramatic improvements in neural network design, with recent results meeting or exceeding the performance of hand-tuned architectures. However, our understanding of how to represent the…

计算机视觉与模式识别 · 计算机科学 2019-03-26 Andrew Hundt , Varun Jain , Gregory D. Hager

Neural Architecture Search (NAS) is challenged by the trade-off between search space exploration and efficiency, especially for complex tasks. While recent LLM-based NAS methods have shown promise, they often suffer from static search…

机器学习 · 计算机科学 2025-07-29 Fei Kong , Xiaohan Shan , Yanwei Hu , Jianmin Li

Architecture design has become a crucial component of successful deep learning. Recent progress in automatic neural architecture search (NAS) shows a lot of promise. However, discovered architectures often fail to generalize in the final…

机器学习 · 计算机科学 2020-04-03 Guohao Li , Guocheng Qian , Itzel C. Delgadillo , Matthias Müller , Ali Thabet , Bernard Ghanem

Recently, Neural Architecture Search has achieved great success in large-scale image classification. In contrast, there have been limited works focusing on architecture search for object detection, mainly because the costly ImageNet…

计算机视觉与模式识别 · 计算机科学 2019-09-06 Junran Peng , Ming Sun , Zhaoxiang Zhang , Tieniu Tan , Junjie Yan

Neural Architecture Search (NAS) represents a class of methods to generate the optimal neural network architecture and typically iterate over candidate architectures till convergence over some particular metric like validation loss. They…

机器学习 · 计算机科学 2019-10-22 Abhishek Singh , Anubhav Garg , Jinan Zhou , Shiv Ram Dubey , Debo Dutta

For the goal of automated design of high-performance deep convolutional neural networks (CNNs), Neural Architecture Search (NAS) methodology is becoming increasingly important for both academia and industries.Due to the costly stochastic…

机器学习 · 计算机科学 2021-10-12 Shengran Hu , Ran Cheng , Cheng He , Zhichao Lu , Jing Wang , Miao Zhang

To achieve excellent performance with modern neural networks, having the right network architecture is important. Neural Architecture Search (NAS) concerns the automatic discovery of task-specific network architectures. Modern NAS…

计算机视觉与模式识别 · 计算机科学 2022-04-29 Alexander Chebykin , Tanja Alderliesten , Peter A. N. Bosman

Conventional Neural Architecture Search (NAS) aims at finding a single architecture that achieves the best performance, which usually optimizes task related learning objectives such as accuracy. However, a single architecture may not be…

机器学习 · 计算机科学 2019-05-24 An-Chieh Cheng , Chieh Hubert Lin , Da-Cheng Juan , Wei Wei , Min Sun

If NAS methods are solutions, what is the problem? Most existing NAS methods require two-stage parameter optimization. However, performance of the same architecture in the two stages correlates poorly. In this work, we propose a new problem…

机器学习 · 计算机科学 2020-04-02 Shoukang Hu , Sirui Xie , Hehui Zheng , Chunxiao Liu , Jianping Shi , Xunying Liu , Dahua Lin

Neural Architecture Search (NAS) has been pivotal in finding optimal network configurations for Convolution Neural Networks (CNNs). While many methods explore NAS from a global search-space perspective, the employed optimization schemes…

计算机视觉与模式识别 · 计算机科学 2021-10-14 Yi Ru Wang , Samir Khaki , Weihang Zheng , Mahdi S. Hosseini , Konstantinos N. Plataniotis

Neural architecture search (NAS) methods rely on a search strategy for deciding which architectures to evaluate next and a performance estimation strategy for assessing their performance (e.g., using full evaluations, multi-fidelity…

神经与进化计算 · 计算机科学 2021-08-10 Noor Awad , Neeratyoy Mallik , Frank Hutter

Neural architecture search (NAS) has a great impact by automatically designing effective neural network architectures. However, the prohibitive computational demand of conventional NAS algorithms (e.g. $10^4$ GPU hours) makes it difficult…

机器学习 · 计算机科学 2019-02-26 Han Cai , Ligeng Zhu , Song Han

Neural Architecture Search (NAS) is an exciting new field which promises to be as much as a game-changer as Convolutional Neural Networks were in 2012. Despite many great works leading to substantial improvements on a variety of tasks,…

机器学习 · 计算机科学 2020-02-17 Antoine Yang , Pedro M. Esperança , Fabio M. Carlucci

Neural Architecture Search (NAS) methods autonomously discover high-accuracy neural network architectures, outperforming manually crafted ones. However, The NAS methods require high computational costs due to the high dimension search space…

神经与进化计算 · 计算机科学 2024-10-31 Zaniar Sharifi , Khabat Soltanian , Ali Amiri

Recently, Neural Architecture Search (NAS) has successfully identified neural network architectures that exceed human designed ones on large-scale image classification. In this paper, we study NAS for semantic image segmentation. Existing…

计算机视觉与模式识别 · 计算机科学 2019-04-09 Chenxi Liu , Liang-Chieh Chen , Florian Schroff , Hartwig Adam , Wei Hua , Alan Yuille , Li Fei-Fei

Neural Architecture Search (NAS) yields state-of-the-art neural networks that outperform their best manually-designed counterparts. However, previous NAS methods search for architectures under one set of training hyper-parameters (i.e., a…

计算机视觉与模式识别 · 计算机科学 2021-04-01 Xiaoliang Dai , Alvin Wan , Peizhao Zhang , Bichen Wu , Zijian He , Zhen Wei , Kan Chen , Yuandong Tian , Matthew Yu , Peter Vajda , Joseph E. Gonzalez