English
Related papers

Related papers: MicroNAS: An Automated Framework for Developing a …

200 papers

Networks found with Neural Architecture Search (NAS) achieve state-of-the-art performance in a variety of tasks, out-performing human-designed networks. However, most NAS methods heavily rely on human-defined assumptions that constrain the…

Computer Vision and Pattern Recognition · Computer Science 2023-01-10 Vasco Lopes , Luís A. Alexandre

Neural architecture search (NAS) methods aim to automatically find the optimal deep neural network (DNN) architecture as measured by a given objective function, typically some combination of task accuracy and inference efficiency. For many…

Machine Learning · Computer Science 2021-10-29 Ravi Krishna , Aravind Kalaiah , Bichen Wu , Maxim Naumov , Dheevatsa Mudigere , Misha Smelyanskiy , Kurt Keutzer

Neural architecture search (NAS) has shown promising results discovering models that are both accurate and fast. For NAS, training a one-shot model has become a popular strategy to rank the relative quality of different architectures (child…

Computer Vision and Pattern Recognition · Computer Science 2020-07-20 Jiahui Yu , Pengchong Jin , Hanxiao Liu , Gabriel Bender , Pieter-Jan Kindermans , Mingxing Tan , Thomas Huang , Xiaodan Song , Ruoming Pang , Quoc Le

High sensitivity of neural architecture search (NAS) methods against their input such as step-size (i.e., learning rate) and search space prevents practitioners from applying them out-of-the-box to their own problems, albeit its purpose is…

Machine Learning · Computer Science 2019-05-22 Youhei Akimoto , Shinichi Shirakawa , Nozomu Yoshinari , Kento Uchida , Shota Saito , Kouhei Nishida

Scaling deep learning recommendation models is an effective way to improve model expressiveness. Existing approaches often incur substantial computational overhead, making them difficult to deploy in large-scale industrial systems under…

Information Retrieval · Computer Science 2026-02-10 Shikang Wu , Hui Lu , Jinqiu Jin , Zheng Chai , Shiyong Hong , Junjie Zhang , Shanlei Mu , Kaiyuan Ma , Tianyi Liu , Yuchao Zheng , Zhe Wang , Jingjian Lin

The success of deep neural networks relies on significant architecture engineering. Recently neural architecture search (NAS) has emerged as a promise to greatly reduce manual effort in network design by automatically searching for optimal…

Computer Vision and Pattern Recognition · Computer Science 2020-02-26 Ning Wang , Yang Gao , Hao Chen , Peng Wang , Zhi Tian , Chunhua Shen , Yanning Zhang

Deep learning has largely reduced the need for manual feature selection in image segmentation. Nevertheless, network architecture optimization and hyperparameter tuning are mostly manual and time consuming. Although there are increasing…

Image and Video Processing · Electrical Eng. & Systems 2019-09-16 Ken C. L. Wong , Mehdi Moradi

Neural Architecture Search (NAS) aims to automate the design of deep neural networks. However, existing NAS techniques often focus on maximising accuracy, neglecting model efficiency. This limitation restricts their use in…

Machine Learning · Computer Science 2025-01-30 Srikanth Thudumu , Hy Nguyen , Hung Du , Nhat Duong , Zafaryab Rasool , Rena Logothetis , Scott Barnett , Rajesh Vasa , Kon Mouzakis

Deploying models across diverse devices demands tradeoffs among multiple objectives due to different resource constraints. Arguably, due to the small model trap problem in multi-objective neural architecture search (MO-NAS) based on a…

Machine Learning · Computer Science 2024-07-19 Peng Liao , XiLu Wang , Yaochu Jin , WenLi Du

Practical use of neural networks often involves requirements on latency, energy and memory among others. A popular approach to find networks under such requirements is through constrained Neural Architecture Search (NAS). However, previous…

Machine Learning · Computer Science 2022-04-28 Niv Nayman , Yonathan Aflalo , Asaf Noy , Rong Jin , Lihi Zelnik-Manor

Deep Neural Networks (DNNs) face interpretability challenges due to their opaque internal representations. While Feature Map Convergence Evaluation (FMCE) quantifies module-level convergence via Feature Map Convergence Scores (FMCS), it…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Zhibo Zhu , Renyu Huang , Lei He

With the growth of adversarial attacks against machine learning models, several concerns have emerged about potential vulnerabilities in designing deep neural network-based intrusion detection systems (IDS). In this paper, we study the…

Machine Learning · Computer Science 2019-11-01 Rana Abou Khamis , Omair Shafiq , Ashraf Matrawy

In this paper, we propose a novel framework for the smart healthcare system, where we employ the compressed sensing (CS) and the combination of the state-of-the-art machine learning based denoiser as well as the alternating direction of…

Computer Vision and Pattern Recognition · Computer Science 2020-04-08 Abrar Zahin , Le Thanh Tan , Rose Qingyang Hu

In the realm of cybersecurity, intrusion detection systems (IDS) detect and prevent attacks based on collected computer and network data. In recent research, IDS models have been constructed using machine learning (ML) and deep learning…

Machine Learning · Computer Science 2023-03-24 Adam M. Lehavi , Seongtae Kim

Differential Neural Architecture Search (NAS) requires all layer choices to be held in memory simultaneously; this limits the size of both search space and final architecture. In contrast, Probabilistic NAS, such as PARSEC, learns a…

Computer Vision and Pattern Recognition · Computer Science 2021-04-01 Zhicheng Yan , Xiaoliang Dai , Peizhao Zhang , Yuandong Tian , Bichen Wu , Matt Feiszli

Early-exit networks are effective solutions for reducing the overall energy consumption and latency of deep learning models by adjusting computation based on the complexity of input data. By incorporating intermediate exit branches into the…

Artificial Intelligence · Computer Science 2025-12-12 Oscar Robben , Saeed Khalilian , Nirvana Meratnia

Hardware-aware Neural Architecture Search (HW-NAS) is a technique used to automatically design the architecture of a neural network for a specific task and target hardware. However, evaluating the performance of candidate architectures is a…

Neural and Evolutionary Computing · Computer Science 2023-11-08 Nilotpal Sinha , Abd El Rahman Shabayek , Anis Kacem , Peyman Rostami , Carl Shneider , Djamila Aouada

In neural architecture search, the structure of the neural network to best model a given dataset is determined by an automated search process. Efficient Neural Architecture Search (ENAS), proposed by Pham et al. (2018), has recently…

Machine Learning · Computer Science 2019-06-19 Prabhant Singh , Tobias Jacobs , Sebastien Nicolas , Mischa Schmidt

In this paper, we propose BNAS-v2 to further improve the efficiency of NAS, embodying both superiorities of BCNN simultaneously. To mitigate the unfair training issue of BNAS, we employ continuous relaxation strategy to make each edge of…

Computer Vision and Pattern Recognition · Computer Science 2021-01-26 Zixiang Ding , Yaran Chen , Nannan Li , Dongbin Zhao

Enhancing the accuracy and efficiency of machine learning algorithms employed in neural interface systems is crucial for advancing next-generation intelligent therapeutic devices. However, current systems often utilize basic machine…

Signal Processing · Electrical Eng. & Systems 2025-03-12 Arshia Afzal , Volkan Cevher , Mahsa Shoaran