English
Related papers

Related papers: TAPAS: Train-less Accuracy Predictor for Architect…

200 papers

Differentiable neural architecture search (DNAS) is known for its capacity in the automatic generation of superior neural networks. However, DNAS based methods suffer from memory usage explosion when the search space expands, which may…

Machine Learning · Computer Science 2021-09-14 Zheyu Yan , Weiwen Jiang , Xiaobo Sharon Hu , Yiyu Shi

Neural architecture search has recently attracted lots of research efforts as it promises to automate the manual design of neural networks. However, it requires a large amount of computing resources and in order to alleviate this, a…

Machine Learning · Computer Science 2019-11-27 Alina Dubatovka , Efi Kokiopoulou , Luciano Sbaiz , Andrea Gesmundo , Gabor Bartok , Jesse Berent

Searching techniques in most of existing neural architecture search (NAS) algorithms are mainly dominated by differentiable methods for the efficiency reason. In contrast, we develop an efficient continuous evolutionary approach for…

Computer Vision and Pattern Recognition · Computer Science 2020-03-10 Zhaohui Yang , Yunhe Wang , Xinghao Chen , Boxin Shi , Chao Xu , Chunjing Xu , Qi Tian , Chang Xu

Neural architecture search (NAS) with an accuracy predictor that predicts the accuracy of candidate architectures has drawn increasing attention due to its simplicity and effectiveness. Previous works usually employ neural network-based…

Machine Learning · Computer Science 2021-07-20 Renqian Luo , Xu Tan , Rui Wang , Tao Qin , Enhong Chen , Tie-Yan Liu

Reliable yet efficient evaluation of generalisation performance of a proposed architecture is crucial to the success of neural architecture search (NAS). Traditional approaches face a variety of limitations: training each architecture to…

Machine Learning · Statistics 2021-06-09 Binxin Ru , Clare Lyle , Lisa Schut , Miroslav Fil , Mark van der Wilk , Yarin Gal

Architectures obtained by Neural Architecture Search (NAS) have achieved highly competitive performance in various computer vision tasks. However, the prohibitive computation demand of forward-backward propagation in deep neural networks…

Machine Learning · Computer Science 2019-08-15 Xiawu Zheng , Rongrong Ji , Lang Tang , Baochang Zhang , Jianzhuang Liu , Qi Tian

Neural architecture search (NAS) has shown promising results discovering models that are both accurate and fast. For NAS, training a one-shot model has become a popular strategy to rank the relative quality of different architectures (child…

Computer Vision and Pattern Recognition · Computer Science 2020-07-20 Jiahui Yu , Pengchong Jin , Hanxiao Liu , Gabriel Bender , Pieter-Jan Kindermans , Mingxing Tan , Thomas Huang , Xiaodan Song , Ruoming Pang , Quoc Le

The neural architecture search (NAS) algorithm with reinforcement learning can be a powerful and novel framework for the automatic discovering process of neural architectures. However, its application is restricted by noncontinuous and…

Machine Learning · Computer Science 2020-03-27 Chun-Ting Liu

Accuracy predictor is a key component in Neural Architecture Search (NAS) for ranking architectures. Building a high-quality accuracy predictor usually costs enormous computation. To address this issue, instead of using an accuracy…

Computer Vision and Pattern Recognition · Computer Science 2021-08-24 Ming Lin , Pichao Wang , Zhenhong Sun , Hesen Chen , Xiuyu Sun , Qi Qian , Hao Li , Rong Jin

Neural Architecture Search (NAS) that aims to automate the procedure of architecture design has achieved promising results in many computer vision fields. In this paper, we propose an AdversarialNAS method specially tailored for Generative…

Computer Vision and Pattern Recognition · Computer Science 2020-04-09 Chen Gao , Yunpeng Chen , Si Liu , Zhenxiong Tan , Shuicheng Yan

In recent years, neural architecture search (NAS) methods have been proposed for the automatic generation of task-oriented network architecture in image classification. However, the architectures obtained by existing NAS approaches are…

Computer Vision and Pattern Recognition · Computer Science 2021-03-24 Haichao Zhang , Kuangrong Hao , Lei Gao , Xuesong Tang , Bing Wei

Neural network (NN) models are increasingly used in scientific simulations, AI, and other high performance computing (HPC) fields to extract knowledge from datasets. Each dataset requires tailored NN model architecture, but designing…

Machine Learning · Computer Science 2021-08-12 Ariel Keller Rorabaugh , Silvina Caíno-Lores , Michael R. Wyatt , Travis Johnston , Michela Taufer

Neural Architecture Search (NAS) refers to automatically design the architecture. We propose an hourglass-inspired approach (HourNAS) for this problem that is motivated by the fact that the effects of the architecture often proceed from the…

Computer Vision and Pattern Recognition · Computer Science 2020-12-09 Zhaohui Yang , Yunhe Wang , Xinghao Chen , Jianyuan Guo , Wei Zhang , Chao Xu , Chunjing Xu , Dacheng Tao , Chang Xu

We achieve very efficient deep learning model deployment that designs neural network architectures to fit different hardware constraints. Given a constraint, most neural architecture search (NAS) methods either sample a set of sub-networks…

Computer Vision and Pattern Recognition · Computer Science 2020-04-10 Sian-Yao Huang , Wei-Ta Chu

Evolutionary Neural Architecture Search (ENAS) can automatically design the architectures of Deep Neural Networks (DNNs) using evolutionary computation algorithms. However, most ENAS algorithms require intensive computational resource,…

Machine Learning · Computer Science 2020-09-08 Yanan Sun , Xian Sun , Yuhan Fang , Gary Yen

Convolutional Neural Networks (CNN) have been regarded as a capable class of models for visual recognition problems. Nevertheless, it is not trivial to develop generic and powerful network architectures, which requires significant efforts…

Computer Vision and Pattern Recognition · Computer Science 2019-09-24 Zhaofan Qiu , Ting Yao , Yiheng Zhang , Yongdong Zhang , Tao Mei

Neural Architecture Search (NAS) has been used recently to achieve improved performance in various tasks and most prominently in image classification. Yet, current search strategies rely on large labeled datasets, which limit their usage in…

Machine Learning · Computer Science 2020-07-06 Sapir Kaplan , Raja Giryes

The recent advent of automated neural network architecture search led to several methods that outperform state-of-the-art human-designed architectures. However, these approaches are computationally expensive, in extreme cases consuming GPU…

Machine Learning · Computer Science 2019-03-11 Martin Wistuba , Tejaswini Pedapati

Neural predictors are effective in boosting the time-consuming performance evaluation stage in neural architecture search (NAS), owing to their direct estimation of unseen architectures. Despite the effectiveness, training a powerful neural…

Machine Learning · Computer Science 2024-06-05 Han Ji , Yuqi Feng , Yanan Sun

Many mission-critical systems are based on GPU for inference. It requires not only high recognition accuracy but also low latency in responding time. Although many studies are devoted to optimizing the structure of deep models for efficient…

Computer Vision and Pattern Recognition · Computer Science 2020-08-13 Ming Lin , Hesen Chen , Xiuyu Sun , Qi Qian , Hao Li , Rong Jin