English
Related papers

Related papers: Resource-Efficient Neural Architect

200 papers

Single Image Super-Resolution (SISR) tasks have achieved significant performance with deep neural networks. However, the large number of parameters in CNN-based met-hods for SISR tasks require heavy computations. Although several efficient…

Image and Video Processing · Electrical Eng. & Systems 2022-12-20 Han Huang , Li Shen , Chaoyang He , Weisheng Dong , Wei Liu

Neural architecture search has shown its great potential in various areas recently. However, existing methods rely heavily on a black-box controller to search architectures, which suffers from the serious problem of lacking…

Machine Learning · Computer Science 2020-09-29 Xinyue Zheng , Peng Wang , Qigang Wang , Zhongchao Shi

Neural architecture search (NAS) searches architectures automatically for given tasks, e.g., image classification and language modeling. Improving the search efficiency and effectiveness have attracted increasing attention in recent years.…

Machine Learning · Computer Science 2020-01-03 Yao Shu , Wei Wang , Shaofeng Cai

Neural network (NN) models are increasingly used in scientific simulations, AI, and other high performance computing (HPC) fields to extract knowledge from datasets. Each dataset requires tailored NN model architecture, but designing…

Machine Learning · Computer Science 2021-08-12 Ariel Keller Rorabaugh , Silvina Caíno-Lores , Michael R. Wyatt , Travis Johnston , Michela Taufer

Different from other deep scalable architecture-based NAS approaches, Broad Neural Architecture Search (BNAS) proposes a broad scalable architecture which consists of convolution and enhancement blocks, dubbed Broad Convolutional Neural…

Computer Vision and Pattern Recognition · Computer Science 2022-08-02 Zixiang Ding , Yaran Chen , Nannan Li , Dongbin Zhao , C. L. Philip Chen

Recent advances in neural architecture search (NAS) demand tremendous computational resources, which makes it difficult to reproduce experiments and imposes a barrier-to-entry to researchers without access to large-scale computation. We aim…

Machine Learning · Computer Science 2019-05-15 Chris Ying , Aaron Klein , Esteban Real , Eric Christiansen , Kevin Murphy , Frank Hutter

Embedded AI systems are expected to incur low power/energy consumption for solving machine learning tasks, as these systems are usually power constrained (e.g., object recognition task in autonomous mobile agents with portable batteries).…

Neural and Evolutionary Computing · Computer Science 2025-07-04 Rachmad Vidya Wicaksana Putra , Muhammad Shafique

Recent advances in adversarial attacks show the vulnerability of deep neural networks searched by Neural Architecture Search (NAS). Although NAS methods can find network architectures with the state-of-the-art performance, the adversarial…

Machine Learning · Computer Science 2020-11-20 Zhixiong Yue , Baijiong Lin , Xiaonan Huang , Yu Zhang

Benefiting from the search efficiency, differentiable neural architecture search (NAS) has evolved as the most dominant alternative to automatically design competitive deep neural networks (DNNs). We note that DNNs must be executed under…

Machine Learning · Computer Science 2022-09-01 Xiangzhong Luo , Di Liu , Hao Kong , Shuo Huai , Hui Chen , Weichen Liu

Networks found with Neural Architecture Search (NAS) achieve state-of-the-art performance in a variety of tasks, out-performing human-designed networks. However, most NAS methods heavily rely on human-defined assumptions that constrain the…

Computer Vision and Pattern Recognition · Computer Science 2023-01-10 Vasco Lopes , Luís A. Alexandre

This paper presents a hardware-efficient deep neural network (DNN), optimized through hardware-aware neural architecture search (HW-NAS); the DNN supports the classification of session-level encrypted traffic on resource-constrained…

Networking and Internet Architecture · Computer Science 2026-03-20 Adel Chehade , Edoardo Ragusa , Paolo Gastaldo , Rodolfo Zunino

Neural Architecture Search (NAS) effectively discovers new Convolutional Neural Network (CNN) architectures, particularly for accuracy optimization. However, prior approaches often require resource-intensive training on super networks or…

Machine Learning · Computer Science 2024-01-18 Ye Qiao , Haocheng Xu , Yifan Zhang , Sitao Huang

How to discover and evaluate the true strength of models quickly and accurately is one of the key challenges in Neural Architecture Search (NAS). To cope with this problem, we propose an Architecture-Driven Weight Prediction (ADWP) approach…

Neural and Evolutionary Computing · Computer Science 2020-03-04 XuZhang , ChenjunZhou , BoGu

Neural architecture search (NAS), an important branch of automatic machine learning, has become an effective approach to automate the design of deep learning models. However, the major issue in NAS is how to reduce the large search time…

Machine Learning · Computer Science 2021-07-15 Jae-hun Shim , Kyeongbo Kong , Suk-Ju Kang

Neural Architecture Search (NAS) has been used recently to achieve improved performance in various tasks and most prominently in image classification. Yet, current search strategies rely on large labeled datasets, which limit their usage in…

Machine Learning · Computer Science 2020-07-06 Sapir Kaplan , Raja Giryes

Neural Architecture Search (NAS) is quickly becoming the go-to approach to optimize the structure of Deep Learning (DL) models for complex tasks such as Image Classification or Object Detection. However, many other relevant applications of…

We propose a novel hardware and software co-exploration framework for efficient neural architecture search (NAS). Different from existing hardware-aware NAS which assumes a fixed hardware design and explores the neural architecture search…

Machine Learning · Computer Science 2020-01-14 Weiwen Jiang , Lei Yang , Edwin Sha , Qingfeng Zhuge , Shouzhen Gu , Sakyasingha Dasgupta , Yiyu Shi , Jingtong Hu

Neural architecture search (NAS) aims to automate architecture design processes and improve the performance of deep neural networks. Platform-aware NAS methods consider both performance and complexity and can find well-performing…

Neural and Evolutionary Computing · Computer Science 2022-07-22 Yuhei Noda , Shota Saito , Shinichi Shirakawa

Designing quantum neural networks (QNNs) that are both accurate and deployable on NISQ hardware is challenging. Handcrafted ansatze must balance expressivity, trainability, and resource use, while limited qubits often necessitate circuit…

Quantum Physics · Physics 2026-04-09 Kooshan Maleki , Alberto Marchisio , Muhammad Shafique

Neural Architecture Search (NAS) is increasingly popular to automatically explore the accuracy versus computational complexity trade-off of Deep Learning (DL) architectures. When targeting tiny edge devices, the main challenge for DL…

Machine Learning · Computer Science 2023-01-26 Matteo Risso , Alessio Burrello , Luca Benini , Enrico Macii , Massimo Poncino , Daniele Jahier Pagliari