English
Related papers

Related papers: Multi-Objective Neural Architecture Search by Lear…

200 papers

Neural architecture search has proven to be a powerful approach to designing and refining neural networks, often boosting their performance and efficiency over manually-designed variations, but comes with computational overhead. While there…

Recently, Neural architecture search has achieved great success on classification tasks for mobile devices. The backbone network for object detection is usually obtained on the image classification task. However, the architecture which is…

Computer Vision and Pattern Recognition · Computer Science 2022-11-08 Haichao Zhang , Jiashi Li , Xin Xia , Kuangrong Hao , Xuefeng Xiao

The deployment of Deep Neural Networks (DNNs) on edge devices is hindered by the substantial gap between performance requirements and available processing power. While recent research has made significant strides in developing pruning…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Hamid Mousavi , Mohammad Loni , Mina Alibeigi , Masoud Daneshtalab

Common Neural Architecture Search methods generate large amounts of candidate architectures that need training in order to assess their performance and find an optimal architecture. To minimize the search time we use different performance…

Machine Learning · Computer Science 2022-06-14 G. G. H. Franken , P. Singh , J. Vanschoren

The ever increasing computational cost of Deep Neural Networks (DNN) and the demand for energy efficient hardware for DNN acceleration has made accuracy and hardware cost co-optimization for DNNs tremendously important, especially for edge…

Machine Learning · Computer Science 2019-06-20 Maryam Parsa , Aayush Ankit , Amirkoushyar Ziabari , Kaushik Roy

Designing neural architectures requires immense manual efforts. This has promoted the development of neural architecture search (NAS) to automate the design. While previous NAS methods achieve promising results but run slowly, zero-cost…

Machine Learning · Computer Science 2023-03-14 Yu Shen , Yang Li , Jian Zheng , Wentao Zhang , Peng Yao , Jixiang Li , Sen Yang , Ji Liu , Bin Cui

As deep neural networks achieve unprecedented performance in various tasks, neural architecture search (NAS), a research field for designing neural network architectures with automated processes, is actively underway. More recently,…

Machine Learning · Computer Science 2022-06-07 Youngkee Kim , Soyi Jung , Minseok Choi , Joongheon Kim

Accurate classification of medical images is essential for modern diagnostics. Deep learning advancements led clinicians to increasingly use sophisticated models to make faster and more accurate decisions, sometimes replacing human…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Lunchen Xie , Eugenio Lomurno , Matteo Gambella , Danilo Ardagna , Manuel Roveri , Matteo Matteucci , Qingjiang Shi

Designing complex architectures has been an essential cogwheel in the revolution deep learning has brought about in the past decade. When solving difficult problems in a datadriven manner, a well-tried approach is to take an architecture…

Machine Learning · Computer Science 2021-10-14 Attila Nagy , Ábel Boros

Modern neural architecture search (NAS) is inherently multi-objective, balancing trade-offs such as accuracy, parameter count, and computational cost. This complexity makes NAS computationally expensive and nearly impossible to solve…

Machine Learning · Computer Science 2025-06-04 Yuyang Zhou , Ferrante Neri , Yew-Soon Ong , Ruibin Bai

One-Shot Neural Architecture Search (NAS) is a promising method to significantly reduce search time without any separate training. It can be treated as a Network Compression problem on the architecture parameters from an over-parameterized…

Machine Learning · Computer Science 2019-06-11 Hongpeng Zhou , Minghao Yang , Jun Wang , Wei Pan

Neural Architecture Search (NAS) has been explosively studied to automate the discovery of top-performer neural networks. Current works require heavy training of supernet or intensive architecture evaluations, thus suffering from heavy…

Computer Vision and Pattern Recognition · Computer Science 2021-03-17 Wuyang Chen , Xinyu Gong , Zhangyang Wang

Neural architecture search (NAS) has become a common approach to developing and discovering new neural architectures for different target platforms and purposes. However, scanning the search space is comprised of long training processes of…

Computer Vision and Pattern Recognition · Computer Science 2022-09-29 Tal Hakim

Neural architecture search (NAS) has attracted a lot of attention and has been illustrated to bring tangible benefits in a large number of applications in the past few years. Architecture topology and architecture size have been regarded as…

Machine Learning · Computer Science 2021-01-27 Xuanyi Dong , Lu Liu , Katarzyna Musial , Bogdan Gabrys

To reduce the human efforts in neural network design, Neural Architecture Search (NAS) has been applied with remarkable success to various high-level vision tasks such as classification and semantic segmentation. The underlying idea for the…

Computer Vision and Pattern Recognition · Computer Science 2020-10-27 Xuelian Cheng , Yiran Zhong , Mehrtash Harandi , Yuchao Dai , Xiaojun Chang , Tom Drummond , Hongdong Li , Zongyuan Ge

Neural architecture search (NAS) approaches aim at automatically finding novel CNN architectures that fit computational constraints while maintaining a good performance on the target platform. We introduce a novel efficient one-shot NAS…

Computer Vision and Pattern Recognition · Computer Science 2020-05-22 Maxim Berman , Leonid Pishchulin , Ning Xu , Matthew B. Blaschko , Gerard Medioni

Resource-constrained edge deployments demand AI solutions that balance high performance with stringent compute, memory, and energy limitations. In this survey, we present a comprehensive overview of the primary strategies for accelerating…

Machine Learning · Computer Science 2025-01-30 Jacob Sander , Achraf Cohen , Venkat R. Dasari , Brent Venable , Brian Jalaian

Deep neural networks (DNNs) have shown superior performances on various multimodal learning problems. However, it often requires huge efforts to adapt DNNs to individual multimodal tasks by manually engineering unimodal features and…

Computer Vision and Pattern Recognition · Computer Science 2022-01-04 Yihang Yin , Siyu Huang , Xiang Zhang

Recent advances in Neural Architecture Search (NAS) which extract specialized hardware-aware configurations (a.k.a. "sub-networks") from a hardware-agnostic "super-network" have become increasingly popular. While considerable effort has…

Artificial Intelligence · Computer Science 2022-03-01 Anthony Sarah , Daniel Cummings , Sharath Nittur Sridhar , Sairam Sundaresan , Maciej Szankin , Tristan Webb , J. Pablo Munoz

Neural Architecture Search (NAS) algorithms aim at finding efficient Deep Neural Network (DNN) architectures for a given application under given system constraints. DNNs are computationally-complex as well as vulnerable to adversarial…

Machine Learning · Computer Science 2025-10-23 Alberto Marchisio , Vojtech Mrazek , Andrea Massa , Beatrice Bussolino , Maurizio Martina , Muhammad Shafique