English
Related papers

Related papers: MIDAS: Mosaic Input-Specific Differentiable Archit…

200 papers

Benefiting from the search efficiency, differentiable neural architecture search (NAS) has evolved as the most dominant alternative to automatically design competitive deep neural networks (DNNs). We note that DNNs must be executed under…

Machine Learning · Computer Science 2022-09-01 Xiangzhong Luo , Di Liu , Hao Kong , Shuo Huai , Hui Chen , Weichen Liu

The search space of neural architecture search (NAS) for convolutional neural network (CNN) is huge. To reduce searching cost, most NAS algorithms use fixed outer network level structure, and search the repeatable cell structure only. Such…

Computer Vision and Pattern Recognition · Computer Science 2020-08-14 Chunnan Wang , Hongzhi Wang , Guosheng Feng , Fei Geng

In differentiable neural architecture search (NAS) algorithms like DARTS, the training set used to update model weight and the validation set used to update model architectures are sampled from the same data distribution. Thus, the uncommon…

Machine Learning · Computer Science 2021-12-02 Ruisi Zhang , Youwei Liang , Sai Ashish Somayajula , Pengtao Xie

Recently, neural architecture search (NAS) methods have attracted much attention and outperformed manually designed architectures on a few high-level vision tasks. In this paper, we propose HiNAS (Hierarchical NAS), an effort towards…

Computer Vision and Pattern Recognition · Computer Science 2020-02-10 Haokui Zhang , Ying Li , Hao Chen , Chunhua Shen

Neural Architecture Search (NAS) has been widely adopted to design neural networks for various computer vision tasks. One of its most promising subdomains is differentiable NAS (DNAS), where the optimal architecture is found in a…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Konstanty Subbotko , Wojciech Jablonski , Piotr Bilinski

Data-driven, automatic design space exploration of neural accelerator architecture is desirable for specialization and productivity. Previous frameworks focus on sizing the numerical architectural hyper-parameters while neglect searching…

Machine Learning · Computer Science 2021-05-28 Yujun Lin , Mengtian Yang , Song Han

Differentiable architecture search (DARTS) provided a fast solution in finding effective network architectures, but suffered from large memory and computing overheads in jointly training a super-network and searching for an optimal…

Computer Vision and Pattern Recognition · Computer Science 2020-04-08 Yuhui Xu , Lingxi Xie , Xiaopeng Zhang , Xin Chen , Guo-Jun Qi , Qi Tian , Hongkai Xiong

Neural Architecture Search (NAS) has become a pivotal technique in automated machine learning. Evolutionary Algorithm (EA)-based methods demonstrate superior search quality but suffer from prohibitive computational costs, while…

Neural and Evolutionary Computing · Computer Science 2026-04-02 Xingbang Du , Enzhi Zhang , Rui Zhong , Yang Cao , Masaharu Munetomo

In this paper, we propose a new neural architecture search (NAS) problem of Symmetric Positive Definite (SPD) manifold networks, aiming to automate the design of SPD neural architectures. To address this problem, we first introduce a…

Machine Learning · Computer Science 2021-06-15 Rhea Sanjay Sukthanker , Zhiwu Huang , Suryansh Kumar , Erik Goron Endsjo , Yan Wu , Luc Van Gool

Morphologically complex languages, particularly multiscript Indian languages, present significant challenges for Natural Language Processing (NLP). This work introduces MorphNAS, a novel differentiable neural architecture search framework…

Computation and Language · Computer Science 2025-08-25 Prathamesh Devadiga , Omkaar Jayadev Shetty , Hiya Nachnani , Prema R

Among existing Neural Architecture Search methods, DARTS is known for its efficiency and simplicity. This approach applies continuous relaxation of network representation to construct a weight-sharing supernet and enables the identification…

Machine Learning · Computer Science 2023-12-21 Hongyi He , Longjun Liu , Haonan Zhang , Nanning Zheng

In this paper, a neural architecture search (NAS) framework is proposed for 3D medical image segmentation, to automatically optimize a neural architecture from a large design space. Our NAS framework searches the structure of each layer…

Machine Learning · Computer Science 2021-10-28 Sungwoong Kim , Ildoo Kim , Sungbin Lim , Woonhyuk Baek , Chiheon Kim , Hyungjoo Cho , Boogeon Yoon , Taesup Kim

Neural Architecture Search (NAS) algorithms automate the task of finding optimal deep learning architectures given an initial search space of possible operations. Developing these search spaces is usually a manual affair with pre-optimized…

Machine Learning · Computer Science 2021-11-08 Robert Wu , Nayan Saxena , Rohan Jain

We present a neural architecture search (NAS) technique to enhance the performance of unsupervised image de-noising, in-painting and super-resolution under the recently proposed Deep Image Prior (DIP). We show that evolutionary search can…

Computer Vision and Pattern Recognition · Computer Science 2020-01-15 Kary Ho , Andrew Gilbert , Hailin Jin , John Collomosse

There has been a large literature of neural architecture search, but most existing work made use of heuristic rules that largely constrained the search flexibility. In this paper, we first relax these manually designed constraints and…

Computer Vision and Pattern Recognition · Computer Science 2020-07-08 Kaifeng Bi , Lingxi Xie , Xin Chen , Longhui Wei , Qi Tian

The use of automatic methods, often referred to as Neural Architecture Search (NAS), in designing neural network architectures has recently drawn considerable attention. In this work, we present an efficient NAS approach, named HM- NAS,…

Machine Learning · Computer Science 2019-09-10 Shen Yan , Biyi Fang , Faen Zhang , Yu Zheng , Xiao Zeng , Hui Xu , Mi Zhang

Recently, much attention has been spent on neural architecture search (NAS), aiming to outperform those manually-designed neural architectures on high-level vision recognition tasks. Inspired by the success, here we attempt to leverage NAS…

Computer Vision and Pattern Recognition · Computer Science 2021-10-12 Haokui Zhang , Ying Li , Hao Chen , Chengrong Gong , Zongwen Bai , Chunhua Shen

Recently proposed neural architecture search (NAS) methods co-train billions of architectures in a supernet and estimate their potential accuracy using the network weights detached from the supernet. However, the ranking correlation between…

Computer Vision and Pattern Recognition · Computer Science 2021-08-24 Jiefeng Peng , Jiqi Zhang , Changlin Li , Guangrun Wang , Xiaodan Liang , Liang Lin

Data augmentation has been an indispensable tool to improve the performance of deep neural networks, however the augmentation can hardly transfer among different tasks and datasets. Consequently, a recent trend is to adopt AutoML technique…

Computer Vision and Pattern Recognition · Computer Science 2021-10-13 Aoming Liu , Zehao Huang , Zhiwu Huang , Naiyan Wang

In this paper, we propose Efficient Progressive Neural Architecture Search (EPNAS), a neural architecture search (NAS) that efficiently handles large search space through a novel progressive search policy with performance prediction based…

Machine Learning · Computer Science 2019-07-11 Yanqi Zhou , Peng Wang , Sercan Arik , Haonan Yu , Syed Zawad , Feng Yan , Greg Diamos