English
Related papers

Related papers: NSGA-Net: Neural Architecture Search using Multi-O…

200 papers

Neural architecture search (NAS) in expressive search spaces is a computationally hard problem, but it also holds the potential to automatically discover completely novel and performant architectures. To achieve this we need effective…

Neural and Evolutionary Computing · Computer Science 2025-12-05 Adri Gómez Martín , Felix Möller , Steven McDonagh , Monica Abella , Manuel Desco , Elliot J. Crowley , Aaron Klein , Linus Ericsson

Neural architecture search (NAS) has attracted increasing attentions in both academia and industry. In the early age, researchers mostly applied individual search methods which sample and evaluate the candidate architectures separately and…

Computer Vision and Pattern Recognition · Computer Science 2020-08-06 Lingxi Xie , Xin Chen , Kaifeng Bi , Longhui Wei , Yuhui Xu , Zhengsu Chen , Lanfei Wang , An Xiao , Jianlong Chang , Xiaopeng Zhang , Qi Tian

Neural architecture search (NAS) aims to automatically design deep neural networks of satisfactory performance. Wherein, architecture performance predictor is critical to efficiently value an intermediate neural architecture. But for the…

Computer Vision and Pattern Recognition · Computer Science 2020-10-16 Yehui Tang , Yunhe Wang , Yixing Xu , Hanting Chen , Chunjing Xu , Boxin Shi , Chao Xu , Qi Tian , Chang Xu

This paper aims at enlarging the problem of Neural Architecture Search (NAS) from Single-Path and Multi-Path Search to automated Mixed-Path Search. In particular, we model the NAS problem as a sparse supernet using a new continuous…

Computer Vision and Pattern Recognition · Computer Science 2021-04-01 Yan Wu , Aoming Liu , Zhiwu Huang , Siwei Zhang , Luc Van Gool

The efficient, automated search for well-performing neural architectures (NAS) has drawn increasing attention in the recent past. Thereby, the predominant research objective is to reduce the necessity of costly evaluations of neural…

Machine Learning · Computer Science 2022-08-02 Jovita Lukasik , Steffen Jung , Margret Keuper

In this paper, we propose Efficient Progressive Neural Architecture Search (EPNAS), a neural architecture search (NAS) that efficiently handles large search space through a novel progressive search policy with performance prediction based…

Machine Learning · Computer Science 2019-07-11 Yanqi Zhou , Peng Wang , Sercan Arik , Haonan Yu , Syed Zawad , Feng Yan , Greg Diamos

Neural structure search (NAS), as the mainstream approach to automate deep neural architecture design, has achieved much success in recent years. However, the performance estimation component adhering to NAS is often prohibitively costly,…

Machine Learning · Computer Science 2022-04-27 Zixuan Liang , Yanan Sun

Despite remarkable progress achieved, most neural architecture search (NAS) methods focus on searching for one single accurate and robust architecture. To further build models with better generalization capability and performance, model…

Computer Vision and Pattern Recognition · Computer Science 2021-07-19 Minghao Chen , Houwen Peng , Jianlong Fu , Haibin Ling

Spiking Neural Networks (SNNs) have received considerable attention not only for their superiority in energy efficiency with discrete signal processing but also for their natural suitability to integrate multi-scale biological plasticity.…

Neural and Evolutionary Computing · Computer Science 2023-11-08 Wenxuan Pan , Feifei Zhao , Guobin Shen , Yi Zeng

The term Neural Architecture Search (NAS) refers to the automatic optimization of network architectures for a new, previously unknown task. Since testing an architecture is computationally very expensive, many optimizers need days or even…

Machine Learning · Computer Science 2019-07-22 Martin Wistuba

Recently, there emerged revived interests of designing automatic programs (e.g., using genetic/evolutionary algorithms) to optimize the structure of Convolutional Neural Networks (CNNs) for a specific task. The challenge in designing such…

Neural and Evolutionary Computing · Computer Science 2018-06-05 Zhe Li , Xuehan Xiong , Zhou Ren , Ning Zhang , Xiaoyu Wang , Tianbao Yang

In this paper, we investigate a new variant of neural architecture search (NAS) paradigm -- searching with random labels (RLNAS). The task sounds counter-intuitive for most existing NAS algorithms since random label provides few information…

Computer Vision and Pattern Recognition · Computer Science 2021-05-26 Xuanyang Zhang , Pengfei Hou , Xiangyu Zhang , Jian Sun

In this paper, we present a novel multi-objective hardware-aware neural architecture search (NAS) framework, namely HSCoNAS, to automate the design of deep neural networks (DNNs) with high accuracy but low latency upon target hardware. To…

Machine Learning · Computer Science 2021-03-16 Xiangzhong Luo , Di Liu , Shuo Huai , Weichen Liu

The goals of this research were to search for Convolutional Neural Network (CNN) architectures, suitable for an on-device processor with limited computing resources, performing at substantially lower Network Architecture Search (NAS) costs.…

Computer Vision and Pattern Recognition · Computer Science 2021-09-01 Chakkrit Termritthikun , Yeshi Jamtsho , Jirarat Ieamsaard , Paisarn Muneesawang , Ivan Lee

Gravitational-wave detection strategies are based on a signal analysis technique known as matched filtering. Despite the success of matched filtering, due to its computational cost, there has been recent interest in developing deep…

General Relativity and Quantum Cosmology · Physics 2022-11-03 Dwyer S. Deighan , Scott E. Field , Collin D. Capano , Gaurav Khanna

Neural architecture search can discover neural networks with good performance, and One-Shot approaches are prevalent. One-Shot approaches typically require a supernet with weight sharing and predictors that predict the performance of…

Machine Learning · Computer Science 2021-08-19 Chia-Hsiang Liu , Yu-Shin Han , Yuan-Yao Sung , Yi Lee , Hung-Yueh Chiang , Kai-Chiang Wu

We propose Efficient Neural Architecture Search (ENAS), a fast and inexpensive approach for automatic model design. In ENAS, a controller learns to discover neural network architectures by searching for an optimal subgraph within a large…

Machine Learning · Computer Science 2018-02-13 Hieu Pham , Melody Y. Guan , Barret Zoph , Quoc V. Le , Jeff Dean

Multi-task neural architecture search (NAS) enables transferring architectural knowledge among different tasks. However, ranking disorder between the source task and the target task degrades the architecture performance on the downstream…

Neural and Evolutionary Computing · Computer Science 2026-02-03 TingJie Zhang , HaiLin Liu

Graph neural architecture search has received a lot of attention as Graph Neural Networks (GNNs) has been successfully applied on the non-Euclidean data recently. However, exploring all possible GNNs architectures in the huge search space…

Machine Learning · Computer Science 2021-12-08 Jiamin Chen , Jianliang Gao , Yibo Chen , Oloulade Babatounde Moctard , Tengfei Lyu , Zhao Li

In this paper, we propose a new neural architecture search (NAS) problem of Symmetric Positive Definite (SPD) manifold networks, aiming to automate the design of SPD neural architectures. To address this problem, we first introduce a…

Machine Learning · Computer Science 2021-06-15 Rhea Sanjay Sukthanker , Zhiwu Huang , Suryansh Kumar , Erik Goron Endsjo , Yan Wu , Luc Van Gool