English
Related papers

Related papers: Chain-structured neural architecture search for fi…

200 papers

Neural architecture search automates the design of neural network architectures usually by exploring a large and thus complex architecture search space. To advance the architecture search, we present a graph diffusion-based NAS approach…

Machine Learning · Computer Science 2024-03-25 Rohan Asthana , Joschua Conrad , Youssef Dawoud , Maurits Ortmanns , Vasileios Belagiannis

Recently proposed neural architecture search (NAS) methods co-train billions of architectures in a supernet and estimate their potential accuracy using the network weights detached from the supernet. However, the ranking correlation between…

Computer Vision and Pattern Recognition · Computer Science 2021-08-24 Jiefeng Peng , Jiqi Zhang , Changlin Li , Guangrun Wang , Xiaodan Liang , Liang Lin

Neural Architecture Search (NAS), aiming at automatically designing neural architectures by machines, has been considered a key step toward automatic machine learning. One notable NAS branch is the weight-sharing NAS, which significantly…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Guangrun Wang , Changlin Li , Liuchun Yuan , Jiefeng Peng , Xiaoyu Xian , Xiaodan Liang , Xiaojun Chang , Liang Lin

Neural Architecture Search (NAS) methods have been growing in popularity. These techniques have been fundamental to automate and speed up the time consuming and error-prone process of synthesizing novel Deep Learning (DL) architectures. NAS…

Machine Learning · Computer Science 2021-01-26 Hadjer Benmeziane , Kaoutar El Maghraoui , Hamza Ouarnoughi , Smail Niar , Martin Wistuba , Naigang Wang

Neural architecture search (NAS) promises to make deep learning accessible to non-experts by automating architecture engineering of deep neural networks. BANANAS is one state-of-the-art NAS method that is embedded within the Bayesian…

Machine Learning · Computer Science 2021-07-16 Lennart Schneider , Florian Pfisterer , Martin Binder , Bernd Bischl

Resource is an important constraint when deploying Deep Neural Networks (DNNs) on mobile and edge devices. Existing works commonly adopt the cell-based search approach, which limits the flexibility of network patterns in learned cell…

Machine Learning · Computer Science 2020-03-04 Tunhou Zhang , Hsin-Pai Cheng , Zhenwen Li , Feng Yan , Chengyu Huang , Hai Li , Yiran Chen

Neural Architecture Search (NAS) has garnered significant research interest due to its capability to discover architectures superior to manually designed ones. Learning text representation is crucial for text classification and other…

Neural architecture search (NAS) aims to discover network architectures with desired properties such as high accuracy or low latency. Recently, differentiable NAS (DNAS) has demonstrated promising results while maintaining a search cost…

Machine Learning · Computer Science 2020-08-31 Arash Vahdat , Arun Mallya , Ming-Yu Liu , Jan Kautz

Present day artificial neural architecture search (NAS) strategies are essentially prediction-error-optimized. That holds true for AI functions in general. From the developmental neuroscience perspective, I present evidence for the central…

Neurons and Cognition · Quantitative Biology 2023-10-06 Martin G. Frasch

Neural Architecture Search (NAS) is an exciting new field which promises to be as much as a game-changer as Convolutional Neural Networks were in 2012. Despite many great works leading to substantial improvements on a variety of tasks,…

Machine Learning · Computer Science 2020-02-17 Antoine Yang , Pedro M. Esperança , Fabio M. Carlucci

Neural architecture search (NAS) recently attracts much research attention because of its ability to identify better architectures than handcrafted ones. However, many NAS methods, which optimize the search process in a discrete search…

Machine Learning · Computer Science 2019-11-22 Quanming Yao , Ju Xu , Wei-Wei Tu , Zhanxing Zhu

One-shot Neural Architecture Search (NAS) aims to minimize the computational expense of discovering state-of-the-art models. However, in the past year attention has been drawn to the comparable performance of naive random search across the…

Machine Learning · Computer Science 2021-06-07 Rob Geada , Dennis Prangle , Andrew Stephen McGough

Recent works have demonstrated that deep learning (DL) based compressed sensing (CS) implementation can accelerate Magnetic Resonance (MR) Imaging by reconstructing MR images from sub-sampled k-space data. However, network architectures…

Image and Video Processing · Electrical Eng. & Systems 2023-11-03 Jiangpeng Yan , Shuo Chen , Yongbing Zhang , Xiu Li

Most conventional Neural Architecture Search (NAS) approaches are limited in that they only generate architectures without searching for the optimal parameters. While some NAS methods handle this issue by utilizing a supernet trained on a…

Machine Learning · Computer Science 2021-10-29 Wonyong Jeong , Hayeon Lee , Gun Park , Eunyoung Hyung , Jinheon Baek , Sung Ju Hwang

Different from other deep scalable architecture-based NAS approaches, Broad Neural Architecture Search (BNAS) proposes a broad scalable architecture which consists of convolution and enhancement blocks, dubbed Broad Convolutional Neural…

Computer Vision and Pattern Recognition · Computer Science 2022-08-02 Zixiang Ding , Yaran Chen , Nannan Li , Dongbin Zhao , C. L. Philip Chen

Neural architecture search (NAS) has become an important approach to automatically find effective architectures. To cover all possible good architectures, we need to search in an extremely large search space with billions of candidate…

Computer Vision and Pattern Recognition · Computer Science 2020-08-06 Yong Guo , Yaofo Chen , Yin Zheng , Peilin Zhao , Jian Chen , Junzhou Huang , Mingkui Tan

Neural Architecture Search (NAS) benchmarks significantly improved the capability of developing and comparing NAS methods while at the same time drastically reduced the computational overhead by providing meta-information about thousands of…

Machine Learning · Computer Science 2023-03-31 Vasco Lopes , Bruno Degardin , Luís A. Alexandre

Differentiable Neural Architecture Search is one of the most popular Neural Architecture Search (NAS) methods for its search efficiency and simplicity, accomplished by jointly optimizing the model weight and architecture parameters in a…

Machine Learning · Computer Science 2021-08-11 Ruochen Wang , Minhao Cheng , Xiangning Chen , Xiaocheng Tang , Cho-Jui Hsieh

This paper addresses the efficiency challenge of Neural Architecture Search (NAS) by formulating the task as a ranking problem. Previous methods require numerous training examples to estimate the accurate performance of architectures,…

Computation and Language · Computer Science 2021-09-20 Chi Hu , Chenglong Wang , Xiangnan Ma , Xia Meng , Yinqiao Li , Tong Xiao , Jingbo Zhu , Changliang Li

Finding a well-performing architecture is often tedious for both DL practitioners and researchers, leading to tremendous interest in the automation of this task by means of neural architecture search (NAS). Although the community has made…

Machine Learning · Computer Science 2020-11-04 Marius Lindauer , Frank Hutter