English
Related papers

Related papers: Best of Both Worlds: AutoML Codesign of a CNN and …

200 papers

Hardware-aware Neural Architecture Search approaches (HW-NAS) automate the design of deep learning architectures, tailored specifically to a given target hardware platform. Yet, these techniques demand substantial computational resources,…

Machine Learning · Computer Science 2024-04-22 Nilotpal Sinha , Peyman Rostami , Abd El Rahman Shabayek , Anis Kacem , Djamila Aouada

Data-driven, automatic design space exploration of neural accelerator architecture is desirable for specialization and productivity. Previous frameworks focus on sizing the numerical architectural hyper-parameters while neglect searching…

Machine Learning · Computer Science 2021-05-28 Yujun Lin , Mengtian Yang , Song Han

Traditional neural architecture search (NAS) has a significant impact in computer vision by automatically designing network architectures for various tasks. In this paper, binarized neural architecture search (BNAS), with a search space of…

Computer Vision and Pattern Recognition · Computer Science 2020-09-10 Hanlin Chen , Li'an Zhuo , Baochang Zhang , Xiawu Zheng , Jianzhuang Liu , Rongrong Ji , David Doermann , Guodong Guo

Deep convolutional neural networks (CNNs) have been widely used in surface defect detection. However, no CNN architecture is suitable for all detection tasks and designing effective task-specific requires considerable effort. The neural…

Computer Vision and Pattern Recognition · Computer Science 2023-11-21 Zhenrong Wang , Bin Li , Weifeng Li , Shuanlong Niu , Wang Miao , Tongzhi Niu

Neural Architecture Search (NAS), together with model scaling, has shown remarkable progress in designing high accuracy and fast convolutional architecture families. However, as neither NAS nor model scaling considers sufficient hardware…

Computer Vision and Pattern Recognition · Computer Science 2021-02-11 Sheng Li , Mingxing Tan , Ruoming Pang , Andrew Li , Liqun Cheng , Quoc Le , Norman P. Jouppi

Neural Architecture Search (NAS) algorithms aim at finding efficient Deep Neural Network (DNN) architectures for a given application under given system constraints. DNNs are computationally-complex as well as vulnerable to adversarial…

Machine Learning · Computer Science 2025-10-23 Alberto Marchisio , Vojtech Mrazek , Andrea Massa , Beatrice Bussolino , Maurizio Martina , Muhammad Shafique

Convolutional neural networks (CNNs) have shown good performance in polarimetric synthetic aperture radar (PolSAR) image classification due to the automation of feature engineering. Excellent hand-crafted architectures of CNNs incorporated…

Computer Vision and Pattern Recognition · Computer Science 2020-12-16 Hongwei Dong , Siyu Zhang , Bin Zou , Lamei Zhang

Neural Architecture Search (NAS) is a powerful tool for automating effective image processing DNN designing. The ranking has been advocated to design an efficient performance predictor for NAS. The previous contrastive method solves the…

Computer Vision and Pattern Recognition · Computer Science 2022-07-13 Bicheng Guo , Tao Chen , Shibo He , Haoyu Liu , Lilin Xu , Peng Ye , Jiming Chen

In view of the performance limitations of fully-decoupled designs for neural architectures and accelerators, hardware-software co-design has been emerging to fully reap the benefits of flexible design spaces and optimize neural network…

Hardware Architecture · Computer Science 2022-03-29 Bingqian Lu , Zheyu Yan , Yiyu Shi , Shaolei Ren

The key challenge in neural architecture search (NAS) is designing how to explore wisely in the huge search space. We propose a new NAS method called TNAS (NAS with trees), which improves search efficiency by exploring only a small number…

Artificial Intelligence · Computer Science 2022-04-12 Guocheng Qian , Xuanyang Zhang , Guohao Li , Chen Zhao , Yukang Chen , Xiangyu Zhang , Bernard Ghanem , Jian Sun

Hardware and neural architecture co-search that automatically generates Artificial Intelligence (AI) solutions from a given dataset is promising to promote AI democratization; however, the amount of time that is required by current…

Machine Learning · Computer Science 2020-07-20 Weiwen Jiang , Lei Yang , Sakyasingha Dasgupta , Jingtong Hu , Yiyu Shi

HardWare-aware Neural Architecture Search (HW-NAS) has recently gained tremendous attention by automating the design of DNNs deployed in more resource-constrained daily life devices. Despite its promising performance, developing optimal…

Machine Learning · Computer Science 2025-03-31 Chaojian Li , Zhongzhi Yu , Yonggan Fu , Yongan Zhang , Yang Zhao , Haoran You , Qixuan Yu , Yue Wang , Yingyan Celine Lin

In recent years, neural architecture search (NAS) methods have been proposed for the automatic generation of task-oriented network architecture in image classification. However, the architectures obtained by existing NAS approaches are…

Computer Vision and Pattern Recognition · Computer Science 2021-03-24 Haichao Zhang , Kuangrong Hao , Lei Gao , Xuesong Tang , Bing Wei

High quality AI solutions require joint optimization of AI algorithms, such as deep neural networks (DNNs), and their hardware accelerators. To improve the overall solution quality as well as to boost the design productivity, efficient…

Hardware Architecture · Computer Science 2020-10-16 Cong Hao , Yao Chen , Xiaofan Zhang , Yuhong Li , Jinjun Xiong , Wen-mei Hwu , Deming Chen

This work presents a novel approach to neural architecture search (NAS) that aims to increase carbon efficiency for the model design process. The proposed framework CE-NAS addresses the key challenge of high carbon cost associated with NAS…

Machine Learning · Computer Science 2024-07-19 Yiyang Zhao , Yunzhuo Liu , Bo Jiang , Tian Guo

Despite the remarkable successes of Convolutional Neural Networks (CNNs) in computer vision, it is time-consuming and error-prone to manually design a CNN. Among various Neural Architecture Search (NAS) methods that are motivated to…

Computer Vision and Pattern Recognition · Computer Science 2021-07-14 Hao Tan , Ran Cheng , Shihua Huang , Cheng He , Changxiao Qiu , Fan Yang , Ping Luo

Recent advances in Neural Architecture Search (NAS) such as one-shot NAS offer the ability to extract specialized hardware-aware sub-network configurations from a task-specific super-network. While considerable effort has been employed…

Machine Learning · Computer Science 2022-05-24 Daniel Cummings , Anthony Sarah , Sharath Nittur Sridhar , Maciej Szankin , Juan Pablo Munoz , Sairam Sundaresan

The automated machine learning (AutoML) field has become increasingly relevant in recent years. These algorithms can develop models without the need for expert knowledge, facilitating the application of machine learning techniques in the…

Machine Learning · Computer Science 2022-12-14 Andrea Falanti , Eugenio Lomurno , Danilo Ardagna , Matteo Matteucci

There is a growing interest in automated neural architecture search (NAS) methods. They are employed to routinely deliver high-quality neural network architectures for various challenging data sets and reduce the designer's effort. The NAS…

Neural and Evolutionary Computing · Computer Science 2022-06-28 Michal Pinos , Vojtech Mrazek , Lukas Sekanina

While maximizing deep neural networks' (DNNs') acceleration efficiency requires a joint search/design of three different yet highly coupled aspects, including the networks, bitwidths, and accelerators, the challenges associated with such a…

Machine Learning · Computer Science 2025-01-07 Yonggan Fu , Yongan Zhang , Yang Zhang , David Cox , Yingyan Celine Lin