English
Related papers

Related papers: The UniNAS framework: combining modules in arbitra…

200 papers

Monumental advances in deep learning have led to unprecedented achievements across various domains. While the performance of deep neural networks is indubitable, the architectural design and interpretability of such models are nontrivial.…

Machine Learning · Computer Science 2023-07-06 Zachariah Carmichael , Tim Moon , Sam Ade Jacobs

Neural Architecture Search (NAS) deployment in industrial production systems faces a fundamental validation bottleneck: verifying a single candidate architecture pi requires evaluating the deployed ensemble of M models, incurring…

Machine Learning · Computer Science 2026-03-23 Yun Chen , Moyu Zhang , Jinxin Hu , Yu Zhang , Xiaoyi Zeng

In this paper, we propose Efficient Progressive Neural Architecture Search (EPNAS), a neural architecture search (NAS) that efficiently handles large search space through a novel progressive search policy with performance prediction based…

Machine Learning · Computer Science 2019-07-11 Yanqi Zhou , Peng Wang , Sercan Arik , Haonan Yu , Syed Zawad , Feng Yan , Greg Diamos

Neural architecture search (NAS) automates the design process of high-performing architectures, but remains bottlenecked by expensive performance evaluation. Most existing studies that achieve faster evaluation are mostly tied to cell-based…

Machine Learning · Computer Science 2025-10-07 Shiwen Qin , Alexander Auras , Shay B. Cohen , Elliot J. Crowley , Michael Moeller , Linus Ericsson , Jovita Lukasik

Weight sharing based and predictor based methods are two major types of fast neural architecture search methods. In this paper, we propose to jointly use weight sharing and predictor in a unified framework. First, we construct a SuperNet in…

Machine Learning · Computer Science 2022-03-07 Ke Lin , Yong A , Zhuoxin Gan , Yingying Jiang

Recently, the expert-crafted neural architectures is increasing overtaken by the utilization of neural architecture search (NAS) and automatic generation (and tuning) of network structures which has a close relation to the Hyperparameter…

Computer Vision and Pattern Recognition · Computer Science 2023-07-19 Seyed Mahdi Shariatzadeh , Mahmood Fathy , Reza Berangi , Mohammad Shahverdy

We propose a novel hardware and software co-exploration framework for efficient neural architecture search (NAS). Different from existing hardware-aware NAS which assumes a fixed hardware design and explores the neural architecture search…

Machine Learning · Computer Science 2020-01-14 Weiwen Jiang , Lei Yang , Edwin Sha , Qingfeng Zhuge , Shouzhen Gu , Sakyasingha Dasgupta , Yiyu Shi , Jingtong Hu

Recommender systems aim to enhance the overall user experience by providing tailored recommendations for a variety of products and services. These systems help users make more informed decisions, leading to greater user engagement with the…

Information Retrieval · Computer Science 2024-02-20 Adamya Shyam , Vikas Kumar , Venkateswara Rao Kagita , Arun K Pujari

Neural networks often encounter various stringent resource constraints while deploying on edge devices. To tackle these problems with less human efforts, automated machine learning becomes popular in finding various neural architectures…

Machine Learning · Computer Science 2022-02-24 Chunhui Zhang , Xiaoming Yuan , Qianyun Zhang , Guangxu Zhu , Lei Cheng , Ning Zhang

We propose Stochastic Neural Architecture Search (SNAS), an economical end-to-end solution to Neural Architecture Search (NAS) that trains neural operation parameters and architecture distribution parameters in same round of…

Machine Learning · Computer Science 2020-04-02 Sirui Xie , Hehui Zheng , Chunxiao Liu , Liang Lin

Neural Architecture Search (NAS) refers to automatically design the architecture. We propose an hourglass-inspired approach (HourNAS) for this problem that is motivated by the fact that the effects of the architecture often proceed from the…

Computer Vision and Pattern Recognition · Computer Science 2020-12-09 Zhaohui Yang , Yunhe Wang , Xinghao Chen , Jianyuan Guo , Wei Zhang , Chao Xu , Chunjing Xu , Dacheng Tao , Chang Xu

Neural architecture search (NAS) is an approach for automatically designing a neural network architecture without human effort or expert knowledge. However, the high computational cost of NAS limits its use in commercial applications. Two…

Machine Learning · Computer Science 2021-03-11 Rei Sato , Jun Sakuma , Youhei Akimoto

Neural architecture search, which aims to automatically search for architectures (e.g., convolution, max pooling) of neural networks that maximize validation performance, has achieved remarkable progress recently. In many application…

Machine Learning · Computer Science 2020-06-24 Ishika Singh , Haoyi Zhou , Kunlin Yang , Meng Ding , Bill Lin , Pengtao Xie

Time-intensive performance evaluations significantly impede progress in Neural Architecture Search (NAS). To address this, neural predictors leverage surrogate models trained on proxy datasets, allowing for direct performance predictions…

Machine Learning · Computer Science 2025-09-24 Jindi Lv , Yuhao Zhou , Yuxin Tian , Qing Ye , Wentao Feng , Jiancheng Lv

The generation of feasible adversarial examples is necessary for properly assessing models that work in constrained feature space. However, it remains a challenging task to enforce constraints into attacks that were designed for computer…

Artificial Intelligence · Computer Science 2022-05-04 Thibault Simonetto , Salijona Dyrmishi , Salah Ghamizi , Maxime Cordy , Yves Le Traon

This paper offers a new perspective on Artificial Neural Networks (ANNs) architecture. Traditional ANNs commonly use tree-like or DAG structures for simplicity, which can be preset or determined by Neural Architecture Search (NAS). Yet,…

Machine Learning · Computer Science 2025-06-05 Xinshun Liu , Yizhi Fang , Yichao Jiang

To prevent the leakage of private information while enabling automated machine intelligence, there is an emerging trend to integrate federated learning and Neural Architecture Search (NAS). Although promising as it may seem, the coupling of…

Machine Learning · Computer Science 2020-11-09 Chunhui Zhang , Yongyuan Liang , Xiaoming Yuan , Lei Cheng

To maximize hardware efficiency and performance accuracy in Compute-In-Memory (CIM)-based neural network accelerators for Artificial Intelligence (AI) applications, co-optimizing both software and hardware design parameters is essential.…

Artificial Intelligence · Computer Science 2025-10-01 Olga Krestinskaya , Mohammed E. Fouda , Ahmed Eltawil , Khaled N. Salama

The use of automatic methods, often referred to as Neural Architecture Search (NAS), in designing neural network architectures has recently drawn considerable attention. In this work, we present an efficient NAS approach, named HM- NAS,…

Machine Learning · Computer Science 2019-09-10 Shen Yan , Biyi Fang , Faen Zhang , Yu Zheng , Xiao Zeng , Hui Xu , Mi Zhang

Compiling applications as unikernels allows them to be tailored to diverse execution environments. Dependency on a monolithic operating system is replaced with linkage against libraries that provide specific services. Doing so in practice…