English
Related papers

Related papers: Optimizing Neural Architecture Search using Limite…

200 papers

Modern convolutional networks such as ResNet and NASNet have achieved state-of-the-art results in many computer vision applications. These architectures consist of stages, which are sets of layers that operate on representations in the same…

Computer Vision and Pattern Recognition · Computer Science 2020-10-21 Artur Jordao , Fernando Akio , Maiko Lie , William Robson Schwartz

Neural architecture search (NAS) aims to produce the optimal sparse solution from a high-dimensional space spanned by all candidate connections. Current gradient-based NAS methods commonly ignore the constraint of sparsity in the search…

Computer Vision and Pattern Recognition · Computer Science 2020-10-14 Yibo Yang , Hongyang Li , Shan You , Fei Wang , Chen Qian , Zhouchen Lin

Customizing Convolution Neural Networks (CNN) for production use has been a challenging task for DL practitioners. This paper intends to expedite the model customization with a model hub that contains the optimized models tiered by their…

Computer Vision and Pattern Recognition · Computer Science 2022-05-03 Linnan Wang , Chenhan Yu , Satish Salian , Slawomir Kierat , Szymon Migacz , Alex Fit Florea

Recently, differentiable search methods have made major progress in reducing the computational costs of neural architecture search. However, these approaches often report lower accuracy in evaluating the searched architecture or…

Computer Vision and Pattern Recognition · Computer Science 2019-04-30 Xin Chen , Lingxi Xie , Jun Wu , Qi Tian

Neural networks have recently had a lot of success for many tasks. However, neural network architectures that perform well are still typically designed manually by experts in a cumbersome trial-and-error process. We propose a new method to…

Machine Learning · Statistics 2017-11-15 Thomas Elsken , Jan-Hendrik Metzen , Frank Hutter

Efficient search is a core issue in Neural Architecture Search (NAS). It is difficult for conventional NAS algorithms to directly search the architectures on large-scale tasks like ImageNet. In general, the cost of GPU hours for NAS grows…

Computer Vision and Pattern Recognition · Computer Science 2020-03-30 Xiyang Dai , Dongdong Chen , Mengchen Liu , Yinpeng Chen , Lu Yuan

Recently, there emerged revived interests of designing automatic programs (e.g., using genetic/evolutionary algorithms) to optimize the structure of Convolutional Neural Networks (CNNs) for a specific task. The challenge in designing such…

Neural and Evolutionary Computing · Computer Science 2018-06-05 Zhe Li , Xuehan Xiong , Zhou Ren , Ning Zhang , Xiaoyu Wang , Tianbao Yang

The searching procedure of neural architecture search (NAS) is notoriously time consuming and cost prohibitive.To make the search space continuous, most existing gradient-based NAS methods relax the categorical choice of a particular…

Computer Vision and Pattern Recognition · Computer Science 2019-12-11 Shoufa Chen , Yunpeng Chen , Shuicheng Yan , Jiashi Feng

Neural architecture search (NAS), the study of automating the discovery of optimal deep neural network architectures for tasks in domains such as computer vision and natural language processing, has seen rapid growth in the machine learning…

Neural and Evolutionary Computing · Computer Science 2022-03-01 Daniel Cummings , Sharath Nittur Sridhar , Anthony Sarah , Maciej Szankin

The automation of neural architecture design has been a coveted alternative to human experts. Recent works have small search space, which is easier to optimize but has a limited upper bound of the optimal solution. Extra human design is…

Computer Vision and Pattern Recognition · Computer Science 2021-08-19 Yuanzheng Ci , Chen Lin , Ming Sun , Boyu Chen , Hongwen Zhang , Wanli Ouyang

Neural Architecture Search (NAS) has been quite successful in constructing state-of-the-art models on a variety of tasks. Unfortunately, the computational cost can make it difficult to scale. In this paper, we make the first attempt to…

Machine Learning · Computer Science 2019-11-18 Albert Shaw , Wei Wei , Weiyang Liu , Le Song , Bo Dai

Neural Architecture Search (NAS) for automatically finding the optimal network architecture has shown some success with competitive performances in various computer vision tasks. However, NAS in general requires a tremendous amount of…

Computer Vision and Pattern Recognition · Computer Science 2022-12-14 Bokyeung Lee , Kyungdeuk Ko , Jonghwan Hong , Hanseok Ko

Many mission-critical systems are based on GPU for inference. It requires not only high recognition accuracy but also low latency in responding time. Although many studies are devoted to optimizing the structure of deep models for efficient…

Computer Vision and Pattern Recognition · Computer Science 2020-08-13 Ming Lin , Hesen Chen , Xiuyu Sun , Qi Qian , Hao Li , Rong Jin

Can we automatically design a Convolutional Network (ConvNet) with the highest image classification accuracy under the latency constraint of a mobile device? Neural Architecture Search (NAS) for ConvNet design is a challenging problem due…

Machine Learning · Computer Science 2019-05-13 Dimitrios Stamoulis , Ruizhou Ding , Di Wang , Dimitrios Lymberopoulos , Bodhi Priyantha , Jie Liu , Diana Marculescu

Architectures obtained by Neural Architecture Search (NAS) have achieved highly competitive performance in various computer vision tasks. However, the prohibitive computation demand of forward-backward propagation in deep neural networks…

Machine Learning · Computer Science 2019-08-15 Xiawu Zheng , Rongrong Ji , Lang Tang , Baochang Zhang , Jianzhuang Liu , Qi Tian

Neural Architecture Search (NAS), a framework which automates the task of designing neural networks, has recently been actively studied in the field of deep learning. However, there are only a few NAS methods suitable for 3D medical image…

Image and Video Processing · Electrical Eng. & Systems 2019-09-04 Woong Bae , Seungho Lee , Yeha Lee , Beomhee Park , Minki Chung , Kyu-Hwan Jung

Current neural architecture search (NAS) algorithms still require expert knowledge and effort to design a search space for network construction. In this paper, we consider automating the search space design to minimize human interference,…

Computer Vision and Pattern Recognition · Computer Science 2021-03-23 Daquan Zhou , Xiaojie Jin , Xiaochen Lian , Linjie Yang , Yujing Xue , Qibin Hou , Jiashi Feng

Neural Architecture Search (NAS) is quickly becoming the go-to approach to optimize the structure of Deep Learning (DL) models for complex tasks such as Image Classification or Object Detection. However, many other relevant applications of…

Latest algorithms for automatic neural architecture search perform remarkable but few of them can effectively design the number of channels for convolutional neural networks and consume less computational efforts. In this paper, we propose…

Computer Vision and Pattern Recognition · Computer Science 2019-09-05 Hui Zhu , Zhulin An , Chuanguang Yang , Xiaolong Hu , Kaiqiang Xu , Yongjun Xu

In the past few years, neural architecture search (NAS) has become an increasingly important tool within the deep learning community. Despite the many recent successes of NAS, however, most existing approaches operate within highly…

Machine Learning · Computer Science 2022-11-14 Charles Jin , Phitchaya Mangpo Phothilimthana , Sudip Roy