English
Related papers

Related papers: GeNAS: Neural Architecture Search with Better Gene…

200 papers

Neural Architecture Search (NAS) is a powerful tool for automating effective image processing DNN designing. The ranking has been advocated to design an efficient performance predictor for NAS. The previous contrastive method solves the…

Computer Vision and Pattern Recognition · Computer Science 2022-07-13 Bicheng Guo , Tao Chen , Shibo He , Haoyu Liu , Lilin Xu , Peng Ye , Jiming Chen

A fundamental question lies in almost every application of deep neural networks: what is the optimal neural architecture given a specific dataset? Recently, several Neural Architecture Search (NAS) frameworks have been developed that use…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-02-04 Weiwen Jiang , Xinyi Zhang , Edwin H. -M. Sha , Lei Yang , Qingfeng Zhuge , Yiyu Shi , Jingtong Hu

In this paper, a neural architecture search (NAS) framework is proposed for 3D medical image segmentation, to automatically optimize a neural architecture from a large design space. Our NAS framework searches the structure of each layer…

Machine Learning · Computer Science 2021-10-28 Sungwoong Kim , Ildoo Kim , Sungbin Lim , Woonhyuk Baek , Chiheon Kim , Hyungjoo Cho , Boogeon Yoon , Taesup Kim

In recent years, neural architecture search (NAS) has received intensive scientific and industrial interest due to its capability of finding a neural architecture with high accuracy for various artificial intelligence tasks such as image…

Machine Learning · Computer Science 2021-01-18 Martin Ferianc , Hongxiang Fan , Miguel Rodrigues

Neural architecture search (NAS) has attracted increasing attentions in both academia and industry. In the early age, researchers mostly applied individual search methods which sample and evaluate the candidate architectures separately and…

Computer Vision and Pattern Recognition · Computer Science 2020-08-06 Lingxi Xie , Xin Chen , Kaifeng Bi , Longhui Wei , Yuhui Xu , Zhengsu Chen , Lanfei Wang , An Xiao , Jianlong Chang , Xiaopeng Zhang , Qi Tian

Neural Architecture Search (NAS) automates the design of high-performing neural networks but typically targets a single predefined task, thereby restricting its real-world applicability. To address this, Meta Neural Architecture Search…

Machine Learning · Computer Science 2025-08-14 Zijun Sun , Yanning Shen

Recently, the expert-crafted neural architectures is increasing overtaken by the utilization of neural architecture search (NAS) and automatic generation (and tuning) of network structures which has a close relation to the Hyperparameter…

Computer Vision and Pattern Recognition · Computer Science 2023-07-19 Seyed Mahdi Shariatzadeh , Mahmood Fathy , Reza Berangi , Mohammad Shahverdy

The success of deep learning in recent years has lead to a rising demand for neural network architecture engineering. As a consequence, neural architecture search (NAS), which aims at automatically designing neural network architectures in…

Computer Vision and Pattern Recognition · Computer Science 2022-02-16 Thomas Elsken , Arber Zela , Jan Hendrik Metzen , Benedikt Staffler , Thomas Brox , Abhinav Valada , Frank Hutter

Existing neural architecture search (NAS) methods often return an architecture with good search performance but generalizes poorly to the test setting. To achieve better generalization, we propose a novel neighborhood-aware NAS formulation…

Machine Learning · Computer Science 2021-11-01 Xiaofang Wang , Shengcao Cao , Mengtian Li , Kris M. Kitani

In this paper, we investigate a new variant of neural architecture search (NAS) paradigm -- searching with random labels (RLNAS). The task sounds counter-intuitive for most existing NAS algorithms since random label provides few information…

Computer Vision and Pattern Recognition · Computer Science 2021-05-26 Xuanyang Zhang , Pengfei Hou , Xiangyu Zhang , Jian Sun

Recent advances in Neural Architecture Search (NAS) such as one-shot NAS offer the ability to extract specialized hardware-aware sub-network configurations from a task-specific super-network. While considerable effort has been employed…

Machine Learning · Computer Science 2022-05-24 Daniel Cummings , Anthony Sarah , Sharath Nittur Sridhar , Maciej Szankin , Juan Pablo Munoz , Sairam Sundaresan

The term Neural Architecture Search (NAS) refers to the automatic optimization of network architectures for a new, previously unknown task. Since testing an architecture is computationally very expensive, many optimizers need days or even…

Machine Learning · Computer Science 2019-07-22 Martin Wistuba

The use of automatic methods, often referred to as Neural Architecture Search (NAS), in designing neural network architectures has recently drawn considerable attention. In this work, we present an efficient NAS approach, named HM- NAS,…

Machine Learning · Computer Science 2019-09-10 Shen Yan , Biyi Fang , Faen Zhang , Yu Zheng , Xiao Zeng , Hui Xu , Mi Zhang

Neural architecture search (NAS) and network pruning are widely studied efficient AI techniques, but not yet perfect. NAS performs exhaustive candidate architecture search, incurring tremendous search cost. Though (structured) pruning can…

Computer Vision and Pattern Recognition · Computer Science 2022-06-03 Yanyu Li , Pu Zhao , Geng Yuan , Xue Lin , Yanzhi Wang , Xin Chen

Traditional neural architecture search (NAS) has a significant impact in computer vision by automatically designing network architectures for various tasks. In this paper, binarized neural architecture search (BNAS), with a search space of…

Computer Vision and Pattern Recognition · Computer Science 2020-09-10 Hanlin Chen , Li'an Zhuo , Baochang Zhang , Xiawu Zheng , Jianzhuang Liu , Rongrong Ji , David Doermann , Guodong Guo

Neural Architecture Search (NAS) has been quite successful in constructing state-of-the-art models on a variety of tasks. Unfortunately, the computational cost can make it difficult to scale. In this paper, we make the first attempt to…

Machine Learning · Computer Science 2019-11-18 Albert Shaw , Wei Wei , Weiyang Liu , Le Song , Bo Dai

Neural Architecture Search (NAS) aims to optimize deep neural networks' architecture for better accuracy or smaller computational cost and has recently gained more research interests. Despite various successful approaches proposed to solve…

Machine Learning · Computer Science 2020-11-03 Bas van Stein , Hao Wang , Thomas Bäck

Neural Architecture Search (NAS) is a popular tool for automatically generating Neural Network (NN) architectures. In early NAS works, these tools typically optimized NN architectures for a single metric, such as accuracy. However, in the…

Neural and Evolutionary Computing · Computer Science 2023-04-05 Emil Njor , Jan Madsen , Xenofon Fafoutis

Neural Architecture Search (NAS) continues to serve a key roll in the design and development of neural networks for task specific deployment. Modern NAS techniques struggle to deal with ever increasing search space complexity and compute…

Computer Vision and Pattern Recognition · Computer Science 2024-11-25 Arjun Sridhar , Yiran Chen

The Neural Architecture Search (NAS) problem is typically formulated as a graph search problem where the goal is to learn the optimal operations over edges in order to maximise a graph-level global objective. Due to the large architecture…

Computer Vision and Pattern Recognition · Computer Science 2023-01-13 Vasco Lopes , Fabio Maria Carlucci , Pedro M Esperança , Marco Singh , Victor Gabillon , Antoine Yang , Hang Xu , Zewei Chen , Jun Wang