English
Related papers

Related papers: Accelerating Neural Architecture Search via Proxy …

200 papers

In this paper, we propose Broad Neural Architecture Search (BNAS) where we elaborately design broad scalable architecture dubbed Broad Convolutional Neural Network (BCNN) to solve the above issue. On one hand, the proposed broad scalable…

Machine Learning · Statistics 2021-03-17 Zixiang Ding , Yaran Chen , Nannan Li , Dongbin Zhao , Zhiquan Sun , C. L. Philip Chen

Neural architecture search can discover neural networks with good performance, and One-Shot approaches are prevalent. One-Shot approaches typically require a supernet with weight sharing and predictors that predict the performance of…

Machine Learning · Computer Science 2021-08-19 Chia-Hsiang Liu , Yu-Shin Han , Yuan-Yao Sung , Yi Lee , Hung-Yueh Chiang , Kai-Chiang Wu

Neural architecture search (NAS) has shown promise towards automating neural network design for a given task, but it is computationally demanding due to training costs associated with evaluating a large number of architectures to find the…

Computer Vision and Pattern Recognition · Computer Science 2025-02-07 Shahid Siddiqui , Christos Kyrkou , Theocharis Theocharides

Neural architecture search (NAS) aims to produce the optimal sparse solution from a high-dimensional space spanned by all candidate connections. Current gradient-based NAS methods commonly ignore the constraint of sparsity in the search…

Computer Vision and Pattern Recognition · Computer Science 2020-10-14 Yibo Yang , Hongyang Li , Shan You , Fei Wang , Chen Qian , Zhouchen Lin

Neural architecture search (NAS) is a recent methodology for automating the design of neural network architectures. Differentiable neural architecture search (DARTS) is a promising NAS approach that dramatically increases search efficiency.…

Machine Learning · Computer Science 2021-04-22 Erik Bodin , Federico Tomasi , Zhenwen Dai

Designing neural architectures requires immense manual efforts. This has promoted the development of neural architecture search (NAS) to automate the design. While previous NAS methods achieve promising results but run slowly, zero-cost…

Machine Learning · Computer Science 2023-03-14 Yu Shen , Yang Li , Jian Zheng , Wentao Zhang , Peng Yao , Jixiang Li , Sen Yang , Ji Liu , Bin Cui

Neural Architecture Search (NAS) is emerging as a new research direction which has the potential to replace the hand-crafted neural architectures designed for specific tasks. Previous evolution based architecture search requires high…

Neural and Evolutionary Computing · Computer Science 2020-12-24 Nilotpal Sinha , Kuan-Wen Chen

Accurate classification of medical images is essential for modern diagnostics. Deep learning advancements led clinicians to increasingly use sophisticated models to make faster and more accurate decisions, sometimes replacing human…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Lunchen Xie , Eugenio Lomurno , Matteo Gambella , Danilo Ardagna , Manuel Roveri , Matteo Matteucci , Qingjiang Shi

Architecture performance evaluation is the most time-consuming part of neural architecture search (NAS). Zero-Shot NAS accelerates the evaluation by utilizing zero-cost proxies instead of training. Though effective, existing zero-cost…

Machine Learning · Computer Science 2025-06-24 Ning Wu , Han Huang , Yueting Xu , Zhifeng Hao

Can we automatically design a Convolutional Network (ConvNet) with the highest image classification accuracy under the latency constraint of a mobile device? Neural Architecture Search (NAS) for ConvNet design is a challenging problem due…

Machine Learning · Computer Science 2019-05-13 Dimitrios Stamoulis , Ruizhou Ding , Di Wang , Dimitrios Lymberopoulos , Bodhi Priyantha , Jie Liu , Diana Marculescu

Neural architecture search (NAS) is a promising approach for automatically designing neural network architectures. However, the architecture estimation of NAS is computationally expensive and time-consuming because of training multiple…

Machine Learning · Computer Science 2025-08-07 Kun Jing , Luoyu Chen , Jungang Xu , Jianwei Tai , Yiyu Wang , Shuaimin Li

Can we reduce the search cost of Neural Architecture Search (NAS) from days down to only few hours? NAS methods automate the design of Convolutional Networks (ConvNets) under hardware constraints and they have emerged as key components of…

Machine Learning · Computer Science 2023-07-19 Dimitrios Stamoulis , Ruizhou Ding , Di Wang , Dimitrios Lymberopoulos , Bodhi Priyantha , Jie Liu , Diana Marculescu

Automatic methods for Neural Architecture Search (NAS) have been shown to produce state-of-the-art network models. Yet, their main drawback is the computational complexity of the search process. As some primal methods optimized over a…

Machine Learning · Statistics 2019-10-11 Asaf Noy , Niv Nayman , Tal Ridnik , Nadav Zamir , Sivan Doveh , Itamar Friedman , Raja Giryes , Lihi Zelnik-Manor

Can we automatically design a Convolutional Network (ConvNet) with the highest image classification accuracy under the runtime constraint of a mobile device? Neural architecture search (NAS) has revolutionized the design of…

Machine Learning · Computer Science 2019-04-08 Dimitrios Stamoulis , Ruizhou Ding , Di Wang , Dimitrios Lymberopoulos , Bodhi Priyantha , Jie Liu , Diana Marculescu

One-shot NAS method has attracted much interest from the research community due to its remarkable training efficiency and capacity to discover high performance models. However, the search spaces of previous one-shot based works usually…

Computer Vision and Pattern Recognition · Computer Science 2020-05-22 Ronghao Guo , Chen Lin , Chuming Li , Keyu Tian , Ming Sun , Lu Sheng , Junjie Yan

We achieve very efficient deep learning model deployment that designs neural network architectures to fit different hardware constraints. Given a constraint, most neural architecture search (NAS) methods either sample a set of sub-networks…

Computer Vision and Pattern Recognition · Computer Science 2020-04-10 Sian-Yao Huang , Wei-Ta Chu

Conventional neural architecture search (NAS) approaches are based on reinforcement learning or evolutionary strategy, which take more than 3000 GPU hours to find a good model on CIFAR-10. We propose an efficient NAS approach learning to…

Computer Vision and Pattern Recognition · Computer Science 2019-10-17 Xuanyi Dong , Yi Yang

Differentiable architecture search (DARTS) has significantly promoted the development of NAS techniques because of its high search efficiency and effectiveness but suffers from performance collapse. In this paper, we make efforts to…

Computer Vision and Pattern Recognition · Computer Science 2022-08-19 Xuanyang Zhang , Yonggang Li , Xiangyu Zhang , Yongtao Wang , Jian Sun

Neural Architecture Search (NAS) has demonstrated state-of-the-art performance on various computer vision tasks. Despite the superior performance achieved, the efficiency and generality of existing methods are highly valued due to their…

Computer Vision and Pattern Recognition · Computer Science 2023-03-13 Xiawu Zheng , Chenyi Yang , Shaokun Zhang , Yan Wang , Baochang Zhang , Yongjian Wu , Yunsheng Wu , Ling Shao , Rongrong Ji

Neural architecture search (NAS) has been successfully applied to tasks like image classification and language modeling for finding efficient high-performance network architectures. In ASR field especially end-to-end ASR, the related…

Sound · Computer Science 2021-08-11 Xian Shi , Pan Zhou , Wei Chen , Lei Xie