English
Related papers

Related papers: RD-NAS: Enhancing One-shot Supernet Ranking Abilit…

200 papers

The algorithms of one-shot neural architecture search(NAS) have been widely used to reduce computation consumption. However, because of the interference among the subnets in which weights are shared, the subnets inherited from these…

Computer Vision and Pattern Recognition · Computer Science 2022-06-15 Jiawei Liu , Kaiyu Zhang , Weitai Hu , Qing Yang

Training-free network architecture search (NAS) aims to discover high-performing networks with zero-cost proxies, capturing network characteristics related to the final performance. However, network rankings estimated by previous…

Computer Vision and Pattern Recognition · Computer Science 2024-03-29 Junghyup Lee , Bumsub Ham

Neural Architecture Search (NAS) is quickly becoming the standard methodology to design neural network models. However, NAS is typically compute-intensive because multiple models need to be evaluated before choosing the best one. To reduce…

Machine Learning · Computer Science 2021-03-22 Mohamed S. Abdelfattah , Abhinav Mehrotra , Łukasz Dudziak , Nicholas D. Lane

One-shot neural architecture search (NAS) applies weight-sharing supernet to reduce the unaffordable computation overhead of automated architecture designing. However, the weight-sharing technique worsens the ranking consistency of…

Computer Vision and Pattern Recognition · Computer Science 2021-08-13 Ziwei Yang , Ruyi Zhang , Zhi Yang , Xubo Yang , Lei Wang , Zheyang Li

Neural architecture search (NAS) has shown great promise in automatically designing lightweight models. However, conventional approaches are insufficient in training the supernet and pay little attention to actual robot hardware resources.…

Robotics · Computer Science 2025-09-26 Shouren Mao , Minghao Qin , Wei Dong , Huajian Liu , Yongzhuo Gao

Differentiable Architecture Search (DARTS) is a simple yet efficient Neural Architecture Search (NAS) method. During the search stage, DARTS trains a supernet by jointly optimizing architecture parameters and network parameters. During the…

Computer Vision and Pattern Recognition · Computer Science 2023-09-04 Xunyu Zhu , Jian Li , Yong Liu , Weiping Wang

The ability to rank candidate architectures is the key to the performance of neural architecture search~(NAS). One-shot NAS is proposed to reduce the expense but shows inferior performance against conventional NAS and is not adequately…

Machine Learning · Computer Science 2020-04-01 Renqian Luo , Tao Qin , Enhong Chen

Despite the increasing interest in neural architecture search (NAS), the significant computational cost of NAS is a hindrance to researchers. Hence, we propose to reduce the cost of NAS using proxy data, i.e., a representative subset of the…

Machine Learning · Computer Science 2021-06-10 Byunggook Na , Jisoo Mok , Hyeokjun Choe , Sungroh Yoon

Recent advances show that Neural Architectural Search (NAS) method is able to find state-of-the-art image classification deep architectures. In this paper, we consider the one-shot NAS problem for resource constrained applications. This…

Computer Vision and Pattern Recognition · Computer Science 2020-01-01 Xiaojie Jin , Jiang Wang , Joshua Slocum , Ming-Hsuan Yang , Shengyang Dai , Shuicheng Yan , Jiashi Feng

Neural Architecture Search (NAS) is a powerful automatic alternative to manual design of a neural network. In the zero-shot version, a fast ranking function is used to compare architectures without training them. The outputs of the ranking…

Machine Learning · Computer Science 2025-02-28 Pavel Rumiantsev , Mark Coates

One-shot NAS method has attracted much interest from the research community due to its remarkable training efficiency and capacity to discover high performance models. However, the search spaces of previous one-shot based works usually…

Computer Vision and Pattern Recognition · Computer Science 2020-05-22 Ronghao Guo , Chen Lin , Chuming Li , Keyu Tian , Ming Sun , Lu Sheng , Junjie Yan

The wide application of pre-trained models is driving the trend of once-for-all training in one-shot neural architecture search (NAS). However, training within a huge sample space damages the performance of individual subnets and requires…

Networking and Internet Architecture · Computer Science 2023-06-19 Haibin Wang , Ce Ge , Hesen Chen , Xiuyu Sun

One-shot Neural architecture search (One-shot NAS) has been proposed as a time-efficient approach to obtain optimal subnet architectures and weights under different complexity cases by training only once. However, the subnet performance…

Computer Vision and Pattern Recognition · Computer Science 2023-07-18 Mingyang Zhang , Xinyi Yu , Haodong Zhao , Linlin Ou

Neural architecture search (NAS) is an approach for automatically designing a neural network architecture without human effort or expert knowledge. However, the high computational cost of NAS limits its use in commercial applications. Two…

Machine Learning · Computer Science 2021-03-11 Rei Sato , Jun Sakuma , Youhei Akimoto

Recently, zero-shot (or training-free) Neural Architecture Search (NAS) approaches have been proposed to liberate NAS from the expensive training process. The key idea behind zero-shot NAS approaches is to design proxies that can predict…

Machine Learning · Computer Science 2024-06-19 Guihong Li , Duc Hoang , Kartikeya Bhardwaj , Ming Lin , Zhangyang Wang , Radu Marculescu

One-Shot Neural architecture search (NAS) attracts broad attention recently due to its capacity to reduce the computational hours through weight sharing. However, extensive experiments on several recent works show that there is no positive…

Machine Learning · Computer Science 2019-07-23 Miao Zhang , Huiqi Li , Shirui Pan , Taoping Liu , Steven Su

Neural Architecture Search (NAS) has become a widely used tool for automating neural network design. While one-shot NAS methods have successfully reduced computational requirements, they often require extensive training. On the other hand,…

Machine Learning · Computer Science 2023-11-23 Hua Zheng , Kuang-Hung Liu , Igor Fedorov , Xin Zhang , Wen-Yen Chen , Wei Wen

Routability optimization in modern EDA tools has benefited greatly from using machine learning (ML) models. Constructing and optimizing the performance of ML models continues to be a challenge. Neural Architecture Search (NAS) serves as a…

Machine Learning · Computer Science 2024-11-22 Arjun Sridhar , Chen-Chia Chang , Junyao Zhang , Yiran Chen

Efficient evaluation of a network architecture drawn from a large search space remains a key challenge in Neural Architecture Search (NAS). Vanilla NAS evaluates each architecture by training from scratch, which gives the true performance…

Machine Learning · Computer Science 2024-08-13 Yiyang Zhao , Linnan Wang , Yuandong Tian , Rodrigo Fonseca , Tian Guo

Zero-shot Neural Architecture Search (NAS) typically optimises the architecture search process by exploiting the network or gradient properties at initialisation through zero-cost proxies. The existing proxies often rely on labelled data,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Rohan Asthana , Joschua Conrad , Maurits Ortmanns , Vasileios Belagiannis
‹ Prev 1 2 3 10 Next ›