English
Related papers

Related papers: Progressive DARTS: Bridging the Optimization Gap f…

200 papers

An effective and efficient architecture performance evaluation scheme is essential for the success of Neural Architecture Search (NAS). To save computational cost, most of existing NAS algorithms often train and evaluate intermediate neural…

Machine Learning · Computer Science 2021-09-27 Yixing Xu , Yunhe Wang , Kai Han , Yehui Tang , Shangling Jui , Chunjing Xu , Chang Xu

Integrating the principles of approximate computing into the design of hardware-aware deep neural networks (DNN) has led to DNNs implementations showing good output quality and highly optimized hardware parameters such as low latency or…

Machine Learning · Computer Science 2025-10-23 Michal Pinos , Lukas Sekanina , Vojtech Mrazek

In the recent past, the success of Neural Architecture Search (NAS) has enabled researchers to broadly explore the design space using learning-based methods. Apart from finding better neural network architectures, the idea of automation has…

Machine Learning · Computer Science 2019-11-04 Qing Lu , Weiwen Jiang , Xiaowei Xu , Yiyu Shi , Jingtong Hu

Recently, Neural Architecture Search has achieved great success in large-scale image classification. In contrast, there have been limited works focusing on architecture search for object detection, mainly because the costly ImageNet…

Computer Vision and Pattern Recognition · Computer Science 2019-09-06 Junran Peng , Ming Sun , Zhaoxiang Zhang , Tieniu Tan , Junjie Yan

Neural architecture search (NAS) has been successfully applied to tasks like image classification and language modeling for finding efficient high-performance network architectures. In ASR field especially end-to-end ASR, the related…

Sound · Computer Science 2021-08-11 Xian Shi , Pan Zhou , Wei Chen , Lei Xie

In neural architecture search (NAS), the space of neural network architectures is automatically explored to maximize predictive accuracy for a given task. Despite the success of recent approaches, most existing methods cannot be directly…

Machine Learning · Statistics 2019-02-15 Francesco Paolo Casale , Jonathan Gordon , Nicolo Fusi

The success of deep learning in recent years has lead to a rising demand for neural network architecture engineering. As a consequence, neural architecture search (NAS), which aims at automatically designing neural network architectures in…

Computer Vision and Pattern Recognition · Computer Science 2022-02-16 Thomas Elsken , Arber Zela , Jan Hendrik Metzen , Benedikt Staffler , Thomas Brox , Abhinav Valada , Frank Hutter

The standard paradigm in Neural Architecture Search (NAS) is to search for a fully deterministic architecture with specific operations and connections. In this work, we instead propose to search for the optimal operation distribution, thus…

Machine Learning · Computer Science 2021-11-09 Xingchen Wan , Binxin Ru , Pedro M. Esperança , Fabio M. Carlucci

The efficient, automated search for well-performing neural architectures (NAS) has drawn increasing attention in the recent past. Thereby, the predominant research objective is to reduce the necessity of costly evaluations of neural…

Machine Learning · Computer Science 2022-08-02 Jovita Lukasik , Steffen Jung , Margret Keuper

Neural architecture search (NAS) is proposed to automate the architecture design process and attracts overwhelming interest from both academia and industry. However, it is confronted with overfitting issue due to the high-dimensional search…

Machine Learning · Computer Science 2019-12-04 Yang Jiang , Cong Zhao , Zeyang Dou , Lei Pang

Neural architecture search (NAS) aims to automatically design deep neural networks of satisfactory performance. Wherein, architecture performance predictor is critical to efficiently value an intermediate neural architecture. But for the…

Computer Vision and Pattern Recognition · Computer Science 2020-10-16 Yehui Tang , Yunhe Wang , Yixing Xu , Hanting Chen , Chunjing Xu , Boxin Shi , Chao Xu , Qi Tian , Chang Xu

We propose a novel hardware and software co-exploration framework for efficient neural architecture search (NAS). Different from existing hardware-aware NAS which assumes a fixed hardware design and explores the neural architecture search…

Machine Learning · Computer Science 2020-01-14 Weiwen Jiang , Lei Yang , Edwin Sha , Qingfeng Zhuge , Shouzhen Gu , Sakyasingha Dasgupta , Yiyu Shi , Jingtong Hu

Evolutionary algorithms (EA) based neural architecture search (NAS) involves evaluating each architecture by training it from scratch, which is extremely time-consuming. This can be reduced by using a supernet for estimating the fitness of…

Neural and Evolutionary Computing · Computer Science 2022-04-04 Nilotpal Sinha , Kuan-Wen Chen

Neural architecture search has shown its great potential in various areas recently. However, existing methods rely heavily on a black-box controller to search architectures, which suffers from the serious problem of lacking…

Machine Learning · Computer Science 2020-09-29 Xinyue Zheng , Peng Wang , Qigang Wang , Zhongchao Shi

Differentiable neural architecture search (DNAS) is known for its capacity in the automatic generation of superior neural networks. However, DNAS based methods suffer from memory usage explosion when the search space expands, which may…

Machine Learning · Computer Science 2021-09-14 Zheyu Yan , Weiwen Jiang , Xiaobo Sharon Hu , Yiyu Shi

This paper proposes a neural architecture search (NAS) method for split computing. Split computing is an emerging machine-learning inference technique that addresses the privacy and latency challenges of deploying deep learning in IoT…

Machine Learning · Computer Science 2022-08-31 Shoma Shimizu , Takayuki Nishio , Shota Saito , Yoichi Hirose , Chen Yen-Hsiu , Shinichi Shirakawa

Point cloud architecture design has become a crucial problem for 3D deep learning. Several efforts exist to manually design architectures with high accuracy in point cloud tasks such as classification, segmentation, and detection. Recent…

Computer Vision and Pattern Recognition · Computer Science 2020-08-25 Guohao Li , Mengmeng Xu , Silvio Giancola , Ali Thabet , Bernard Ghanem

Neural architecture search (NAS) is a challenging problem. Hierarchical search spaces allow for cheap evaluations of neural network sub modules to serve as surrogate for architecture evaluations. Yet, sometimes the hierarchy is too…

Neural and Evolutionary Computing · Computer Science 2024-04-26 Simon Neumeyer , Julian Stier , Michael Granitzer

Weight sharing, as an approach to speed up architecture performance estimation has received wide attention. Instead of training each architecture separately, weight sharing builds a supernet that assembles all the architectures as its…

Machine Learning · Computer Science 2021-05-06 Yuge Zhang , Quanlu Zhang , Yaming Yang

Time-intensive performance evaluations significantly impede progress in Neural Architecture Search (NAS). To address this, neural predictors leverage surrogate models trained on proxy datasets, allowing for direct performance predictions…

Machine Learning · Computer Science 2025-09-24 Jindi Lv , Yuhao Zhou , Yuxin Tian , Qing Ye , Wentao Feng , Jiancheng Lv