English
Related papers

Related papers: Speedy Performance Estimation for Neural Architect…

200 papers

Neural architecture search (NAS) aims to discover network architectures with desired properties such as high accuracy or low latency. Recently, differentiable NAS (DNAS) has demonstrated promising results while maintaining a search cost…

Machine Learning · Computer Science 2020-08-31 Arash Vahdat , Arun Mallya , Ming-Yu Liu , Jan Kautz

Neural architecture search (NAS) aims to automate the search procedure of architecture instead of manual design. Even if recent NAS approaches finish the search within days, lengthy training is still required for a specific architecture…

Computer Vision and Pattern Recognition · Computer Science 2021-01-26 Xuanyi Dong , Yi Yang

As deep neural networks achieve unprecedented performance in various tasks, neural architecture search (NAS), a research field for designing neural network architectures with automated processes, is actively underway. More recently,…

Machine Learning · Computer Science 2022-06-07 Youngkee Kim , Soyi Jung , Minseok Choi , Joongheon Kim

Finding a well-performing architecture is often tedious for both DL practitioners and researchers, leading to tremendous interest in the automation of this task by means of neural architecture search (NAS). Although the community has made…

Machine Learning · Computer Science 2020-11-04 Marius Lindauer , Frank Hutter

Neural Architecture Search (NAS) yields state-of-the-art neural networks that outperform their best manually-designed counterparts. However, previous NAS methods search for architectures under one set of training hyper-parameters (i.e., a…

Computer Vision and Pattern Recognition · Computer Science 2021-04-01 Xiaoliang Dai , Alvin Wan , Peizhao Zhang , Bichen Wu , Zijian He , Zhen Wei , Kan Chen , Yuandong Tian , Matthew Yu , Peter Vajda , Joseph E. Gonzalez

Neural architecture search (NAS) algorithms save tremendous labor from human experts. Recent advancements further reduce the computational overhead to an affordable level. However, it is still cumbersome to deploy the NAS techniques in…

Computer Vision and Pattern Recognition · Computer Science 2022-06-10 Zhuowei Li , Yibo Gao , Zhenzhou Zha , Zhiqiang HU , Qing Xia , Shaoting Zhang , Dimitris N. Metaxas

Neural architecture search (NAS) has become increasingly popular in the deep learning community recently, mainly because it can provide an opportunity to allow interested users without rich expertise to benefit from the success of deep…

Machine Learning · Computer Science 2022-10-25 Shiqing Liu , Haoyu Zhang , Yaochu Jin

Existing Neural Architecture Search (NAS) methods either encode neural architectures using discrete encodings that do not scale well, or adopt supervised learning-based methods to jointly learn architecture representations and optimize…

Computer Vision and Pattern Recognition · Computer Science 2020-10-27 Shen Yan , Yu Zheng , Wei Ao , Xiao Zeng , Mi Zhang

The most significant barrier to the advancement of Neural Architecture Search (NAS) is its demand for large computational resources, which hinders scientifically sound empirical evaluations of NAS methods. Tabular NAS benchmarks have…

Machine Learning · Computer Science 2022-04-15 Arber Zela , Julien Siems , Lucas Zimmer , Jovita Lukasik , Margret Keuper , Frank Hutter

Deep neural networks have brought significant advancements to speech emotion recognition (SER). However, the architecture design in SER is mainly based on expert knowledge and empirical (trial-and-error) evaluations, which is time-consuming…

Sound · Computer Science 2022-04-01 Xixin Wu , Shoukang Hu , Zhiyong Wu , Xunying Liu , Helen Meng

The searching procedure of neural architecture search (NAS) is notoriously time consuming and cost prohibitive.To make the search space continuous, most existing gradient-based NAS methods relax the categorical choice of a particular…

Computer Vision and Pattern Recognition · Computer Science 2019-12-11 Shoufa Chen , Yunpeng Chen , Shuicheng Yan , Jiashi Feng

Due to the recent advances on Neural Architecture Search (NAS), it gains popularity in designing best networks for specific tasks. Although it shows promising results on many benchmarks and competitions, NAS still suffers from its demanding…

Machine Learning · Computer Science 2019-11-22 Minje Park

Common Neural Architecture Search methods generate large amounts of candidate architectures that need training in order to assess their performance and find an optimal architecture. To minimize the search time we use different performance…

Machine Learning · Computer Science 2022-06-14 G. G. H. Franken , P. Singh , J. Vanschoren

Architecture search is the process of automatically learning the neural model or cell structure that best suits the given task. Recently, this approach has shown promising performance improvements (on language modeling and image…

Computation and Language · Computer Science 2019-06-13 Ramakanth Pasunuru , Mohit Bansal

In prediction-based Neural Architecture Search (NAS), performance indicators derived from graph convolutional networks have shown remarkable success. These indicators, achieved by representing feed-forward structures as component graphs…

Machine Learning · Computer Science 2023-09-25 Minh Le , Nhan Nguyen , Ngoc Hoang Luong

In this paper, we investigate a new variant of neural architecture search (NAS) paradigm -- searching with random labels (RLNAS). The task sounds counter-intuitive for most existing NAS algorithms since random label provides few information…

Computer Vision and Pattern Recognition · Computer Science 2021-05-26 Xuanyang Zhang , Pengfei Hou , Xiangyu Zhang , Jian Sun

Evolutionary Neural Architecture Search (ENAS) can automatically design the architectures of Deep Neural Networks (DNNs) using evolutionary computation algorithms. However, most ENAS algorithms require intensive computational resource,…

Machine Learning · Computer Science 2020-09-08 Yanan Sun , Xian Sun , Yuhan Fang , Gary Yen

Accuracy predictor is a key component in Neural Architecture Search (NAS) for ranking architectures. Building a high-quality accuracy predictor usually costs enormous computation. To address this issue, instead of using an accuracy…

Computer Vision and Pattern Recognition · Computer Science 2021-08-24 Ming Lin , Pichao Wang , Zhenhong Sun , Hesen Chen , Xiuyu Sun , Qi Qian , Hao Li , Rong Jin

Neural Architecture Search (NAS), i.e., the automation of neural network design, has gained much popularity in recent years with increasingly complex search algorithms being proposed. Yet, solid comparisons with simple baselines are often…

Neural and Evolutionary Computing · Computer Science 2020-07-28 T. Den Ottelander , A. Dushatskiy , M. Virgolin , P. A. N. Bosman

Conventional Neural Architecture Search (NAS) aims at finding a single architecture that achieves the best performance, which usually optimizes task related learning objectives such as accuracy. However, a single architecture may not be…

Machine Learning · Computer Science 2019-05-24 An-Chieh Cheng , Chieh Hubert Lin , Da-Cheng Juan , Wei Wei , Min Sun