English
Related papers

Related papers: Poisoning the Search Space in Neural Architecture …

200 papers

Neural architecture search (NAS) has dramatically advanced the development of neural network design. We revisit the search space design in most previous NAS methods and find the number and widths of blocks are set manually. However, block…

Computer Vision and Pattern Recognition · Computer Science 2020-04-10 Jiemin Fang , Yuzhu Sun , Qian Zhang , Yuan Li , Wenyu Liu , Xinggang Wang

Monumental advances in deep learning have led to unprecedented achievements across various domains. While the performance of deep neural networks is indubitable, the architectural design and interpretability of such models are nontrivial.…

Machine Learning · Computer Science 2023-07-06 Zachariah Carmichael , Tim Moon , Sam Ade Jacobs

Automatic methods for Neural Architecture Search (NAS) have been shown to produce state-of-the-art network models. Yet, their main drawback is the computational complexity of the search process. As some primal methods optimized over a…

Machine Learning · Statistics 2019-10-11 Asaf Noy , Niv Nayman , Tal Ridnik , Nadav Zamir , Sivan Doveh , Itamar Friedman , Raja Giryes , Lihi Zelnik-Manor

This work presents a novel approach to neural architecture search (NAS) that aims to increase carbon efficiency for the model design process. The proposed framework CE-NAS addresses the key challenge of high carbon cost associated with NAS…

Machine Learning · Computer Science 2024-07-19 Yiyang Zhao , Yunzhuo Liu , Bo Jiang , Tian Guo

Neural Architecture Search (NAS) has gained significant popularity as an effective tool for designing high performance deep neural networks (DNNs). NAS can be performed via policy gradient, evolutionary algorithms, differentiable…

Machine Learning · Computer Science 2021-04-27 Hanxun Huang , Xingjun Ma , Sarah M. Erfani , James Bailey

Convolutional neural networks (CNNs) have shown good performance in polarimetric synthetic aperture radar (PolSAR) image classification due to the automation of feature engineering. Excellent hand-crafted architectures of CNNs incorporated…

Computer Vision and Pattern Recognition · Computer Science 2020-12-16 Hongwei Dong , Siyu Zhang , Bin Zou , Lamei Zhang

Recent advancements in artificial intelligence (AI) have positioned deep learning (DL) as a pivotal technology in fields like computer vision, data mining, and natural language processing. A critical factor in DL performance is the…

Machine Learning · Computer Science 2024-06-26 Jiaming Yan

Deep Learning models have experienced exponential growth in complexity and resource demands in recent years. Accelerating these models for efficient execution on resource-constrained devices has become more crucial than ever. Two notable…

Machine Learning · Computer Science 2024-08-09 Inas Bachiri , Hadjer Benmeziane , Smail Niar , Riyadh Baghdadi , Hamza Ouarnoughi , Abdelkrime Aries

Automatic neural architecture design has shown its potential in discovering powerful neural network architectures. Existing methods, no matter based on reinforcement learning or evolutionary algorithms (EA), conduct architecture search in a…

Machine Learning · Computer Science 2019-09-05 Renqian Luo , Fei Tian , Tao Qin , Enhong Chen , Tie-Yan Liu

Neural Architecture Search (NAS) has received increasing attention because of its exceptional merits in automating the design of Deep Neural Network (DNN) architectures. However, the performance evaluation process, as a key part of NAS,…

Neural and Evolutionary Computing · Computer Science 2024-10-10 Xiaotian Song , Xiangning Xie , Zeqiong Lv , Gary G. Yen , Weiping Ding , Jiancheng Lv , Yanan Sun

Deep Neural Networks are vulnerable to adversarial attacks. Neural Architecture Search (NAS), one of the driving tools of deep neural networks, demonstrates superior performance in prediction accuracy in various machine learning…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Utkarsh Nath , Yancheng Wang , Yingzhen Yang

Neural Architecture Search (NAS) algorithms automate the task of finding optimal deep learning architectures given an initial search space of possible operations. Developing these search spaces is usually a manual affair with pre-optimized…

Machine Learning · Computer Science 2021-11-08 Robert Wu , Nayan Saxena , Rohan Jain

One-Shot Neural architecture search (NAS) attracts broad attention recently due to its capacity to reduce the computational hours through weight sharing. However, extensive experiments on several recent works show that there is no positive…

Machine Learning · Computer Science 2019-07-23 Miao Zhang , Huiqi Li , Shirui Pan , Taoping Liu , Steven Su

Neural Architecture Search (NAS) has emerged as a favoured method for unearthing effective neural architectures. Recent development of large models has intensified the demand for faster search speeds and more accurate search results.…

Machine Learning · Computer Science 2023-11-14 Wang Qinsi , Ke Jinghan , Liang Zhi , Zhang Sihai

Neural architecture search (NAS) has witnessed prevailing success in image classification and (very recently) segmentation tasks. In this paper, we present the first preliminary study on introducing the NAS algorithm to generative…

Computer Vision and Pattern Recognition · Computer Science 2019-08-13 Xinyu Gong , Shiyu Chang , Yifan Jiang , Zhangyang Wang

Spiking Neural Networks (SNNs) have gained huge attention as a potential energy-efficient alternative to conventional Artificial Neural Networks (ANNs) due to their inherent high-sparsity activation. However, most prior SNN methods use…

Neural and Evolutionary Computing · Computer Science 2022-07-22 Youngeun Kim , Yuhang Li , Hyoungseob Park , Yeshwanth Venkatesha , Priyadarshini Panda

Neural Architecture Search (NAS) is an exciting new field which promises to be as much as a game-changer as Convolutional Neural Networks were in 2012. Despite many great works leading to substantial improvements on a variety of tasks,…

Machine Learning · Computer Science 2020-02-17 Antoine Yang , Pedro M. Esperança , Fabio M. Carlucci

Neural Architecture Search (NAS) is a collection of methods to craft the way neural networks are built. Current NAS methods are far from ab initio and automatic, as they use manual backbone architectures or micro building blocks (cells),…

Machine Learning · Computer Science 2020-10-20 Anubhav Garg , Amit Kumar Saha , Debo Dutta

Edge computing aims to enable edge devices, such as IoT devices, to process data locally instead of relying on the cloud. However, deep learning techniques like computer vision and natural language processing can be computationally…

Computer Vision and Pattern Recognition · Computer Science 2023-07-11 Oshin Dutta , Tanu Kanvar , Sumeet Agarwal

The paper provides a comprehensive overview of Neural Architecture Search (NAS), emphasizing its evolution from manual design to automated, computationally-driven approaches. It covers the inception and growth of NAS, highlighting its…

Neural and Evolutionary Computing · Computer Science 2024-04-03 Fanfei Meng , Chen-Ao Wang , Lele Zhang
‹ Prev 1 4 5 6 7 8 10 Next ›