English
Related papers

Related papers: Weight-Sharing Neural Architecture Search: A Battl…

200 papers

Modern Neural Architecture Search methods have repeatedly broken state-of-the-art results for several disciplines. The super-network, a central component of many such methods, enables quick estimates of accuracy or loss statistics for any…

Machine Learning · Computer Science 2021-12-16 Kevin Alexander Laube , Andreas Zell

Neural architecture search (NAS) has emerged as one successful technique to find robust deep neural network (DNN) architectures. However, most existing robustness evaluations in NAS only consider $l_{\infty}$ norm-based adversarial noises.…

Computer Vision and Pattern Recognition · Computer Science 2023-05-15 Jialiang Sun , Wen Yao , Tingsong Jiang , Xiaoqian Chen

We propose Efficient Neural Architecture Search (ENAS), a fast and inexpensive approach for automatic model design. In ENAS, a controller learns to discover neural network architectures by searching for an optimal subgraph within a large…

Machine Learning · Computer Science 2018-02-13 Hieu Pham , Melody Y. Guan , Barret Zoph , Quoc V. Le , Jeff Dean

Neural Architecture Search (NAS) represents an emerging machine learning (ML) paradigm that automatically searches for models tailored to given tasks, which greatly simplifies the development of ML systems and propels the trend of ML…

Machine Learning · Computer Science 2021-10-13 Ren Pang , Zhaohan Xi , Shouling Ji , Xiapu Luo , Ting Wang

Neural architecture search (NAS) is a hard computationally expensive optimization problem with a discrete, vast, and spiky search space. One of the key research efforts dedicated to this space focuses on accelerating NAS via certain proxy…

Machine Learning · Computer Science 2025-09-09 Bo Lyu , Yu Cui , Tuo Shi , Ke Li

Networks found with Neural Architecture Search (NAS) achieve state-of-the-art performance in a variety of tasks, out-performing human-designed networks. However, most NAS methods heavily rely on human-defined assumptions that constrain the…

Computer Vision and Pattern Recognition · Computer Science 2023-01-10 Vasco Lopes , Luís A. Alexandre

One-shot Neural architecture search (One-shot NAS) has been proposed as a time-efficient approach to obtain optimal subnet architectures and weights under different complexity cases by training only once. However, the subnet performance…

Computer Vision and Pattern Recognition · Computer Science 2023-07-18 Mingyang Zhang , Xinyi Yu , Haodong Zhao , Linlin Ou

By the widespread popularity of electronic devices, the emergence of biometric technology has brought significant convenience to user authentication compared with the traditional password and mode unlocking. Among many biological…

Computer Vision and Pattern Recognition · Computer Science 2019-04-29 Ning Zhu

In this paper, we propose the CrossNAS framework, an automated approach for exploring a vast, multidimensional search space that spans various design abstraction layers-circuits, architecture, and systems-to optimize the deployment of…

Emerging Technologies · Computer Science 2025-07-04 Md Hasibul Amin , Mohammadreza Mohammadi , Jason D. Bakos , Ramtin Zand

Neural Architecture Search (NAS), aiming at automatically designing network architectures by machines, is hoped and expected to bring about a new revolution in machine learning. Despite these high expectation, the effectiveness and…

Computer Vision and Pattern Recognition · Computer Science 2020-03-09 Changlin Li , Jiefeng Peng , Liuchun Yuan , Guangrun Wang , Xiaodan Liang , Liang Lin , Xiaojun Chang

Neural architecture search (NAS) aims to discover network architectures with desired properties such as high accuracy or low latency. Recently, differentiable NAS (DNAS) has demonstrated promising results while maintaining a search cost…

Machine Learning · Computer Science 2020-08-31 Arash Vahdat , Arun Mallya , Ming-Yu Liu , Jan Kautz

Over the past several years progress in designing better neural network architectures for visual recognition has been substantial. To help sustain this rate of progress, in this work we propose to reexamine the methodology for comparing…

Computer Vision and Pattern Recognition · Computer Science 2019-05-31 Ilija Radosavovic , Justin Johnson , Saining Xie , Wan-Yen Lo , Piotr Dollár

In the past few years, neural architecture search (NAS) has become an increasingly important tool within the deep learning community. Despite the many recent successes of NAS, however, most existing approaches operate within highly…

Machine Learning · Computer Science 2022-11-14 Charles Jin , Phitchaya Mangpo Phothilimthana , Sudip Roy

Neural Architecture Search (NAS) is an open and challenging problem in machine learning. While NAS offers great promise, the prohibitive computational demand of most of the existing NAS methods makes it difficult to directly search the…

Computer Vision and Pattern Recognition · Computer Science 2021-02-15 Rameswar Panda , Michele Merler , Mayoore Jaiswal , Hui Wu , Kandan Ramakrishnan , Ulrich Finkler , Chun-Fu Chen , Minsik Cho , David Kung , Rogerio Feris , Bishwaranjan Bhattacharjee

Spiking Neural Networks (SNNs) have gained huge attention as a potential energy-efficient alternative to conventional Artificial Neural Networks (ANNs) due to their inherent high-sparsity activation. However, most prior SNN methods use…

Neural and Evolutionary Computing · Computer Science 2022-07-22 Youngeun Kim , Yuhang Li , Hyoungseob Park , Yeshwanth Venkatesha , Priyadarshini Panda

Neural architecture search (NAS) is proposed to automate the architecture design process and attracts overwhelming interest from both academia and industry. However, it is confronted with overfitting issue due to the high-dimensional search…

Machine Learning · Computer Science 2019-12-04 Yang Jiang , Cong Zhao , Zeyang Dou , Lei Pang

One-shot methods have significantly advanced the field of neural architecture search (NAS) by adopting weight-sharing strategy to reduce search costs. However, the accuracy of performance estimation can be compromised by co-adaptation.…

Machine Learning · Computer Science 2024-12-17 Jianfeng Li , Jiawen Zhang , Feng Wang , Lianbo Ma

Semantic segmentation of 3D medical images is a challenging task due to the high variability of the shape and pattern of objects (such as organs or tumors). Given the recent success of deep learning in medical image segmentation, Neural…

Image and Video Processing · Electrical Eng. & Systems 2022-03-25 Cheng Peng , Andriy Myronenko , Ali Hatamizadeh , Vish Nath , Md Mahfuzur Rahman Siddiquee , Yufan He , Daguang Xu , Rama Chellappa , Dong Yang

Differentiable architecture search (DAS) is a widely researched tool for the discovery of novel architectures, due to its promising results for image classification. The main benefit of DAS is the effectiveness achieved through the…

Machine Learning · Computer Science 2023-02-21 Jonas Geiping , Jovita Lukasik , Margret Keuper , Michael Moeller

Neural Architectures Search (NAS) becomes more and more popular over these years. However, NAS-generated models tends to suffer greater vulnerability to various malicious attacks. Lots of robust NAS methods leverage adversarial training to…

Machine Learning · Computer Science 2023-04-11 Xunyu Zhu , Jian Li , Yong Liu , Weiping Wang