English
Related papers

Related papers: BANANAS: Bayesian Optimization with Neural Archite…

200 papers

Neural Architecture Search (NAS) effectively discovers new Convolutional Neural Network (CNN) architectures, particularly for accuracy optimization. However, prior approaches often require resource-intensive training on super networks or…

Machine Learning · Computer Science 2024-01-18 Ye Qiao , Haocheng Xu , Yifan Zhang , Sitao Huang

Neural Architecture Search (NAS) has emerged as a key tool in identifying optimal configurations of deep neural networks tailored to specific tasks. However, training and assessing numerous architectures introduces considerable…

Machine Learning · Computer Science 2024-04-25 Haoming Zhang , Ran Cheng

Deep neural networks have recently drawn considerable attention to build and evaluate artificial learning models for perceptual tasks. Here, we present a study on the performance of the deep learning models to deal with global optimization…

Neural and Evolutionary Computing · Computer Science 2020-12-18 Hojjat Rakhshani , Lhassane Idoumghar , Soheila Ghambari , Julien Lepagnot , Mathieu Brévilliers

Neural Architecture Search (NAS) methods have been growing in popularity. These techniques have been fundamental to automate and speed up the time consuming and error-prone process of synthesizing novel Deep Learning (DL) architectures. NAS…

Machine Learning · Computer Science 2021-01-26 Hadjer Benmeziane , Kaoutar El Maghraoui , Hamza Ouarnoughi , Smail Niar , Martin Wistuba , Naigang Wang

Bayesian Optimization (BO) is an effective framework for globally optimizing functions whose evaluations are expensive. It is particularly effective for optimizing functions defined over continuous domains and explicitly handles stochastic…

Computational Engineering, Finance, and Science · Computer Science 2026-05-21 Buqing Ou , Frederike Dümbgen

Neural architecture search (NAS) has seen a steep rise in interest over the last few years. Many algorithms for NAS consist of searching through a space of architectures by iteratively choosing an architecture, evaluating its performance by…

Machine Learning · Computer Science 2022-04-26 Colin White , Sam Nolen , Yash Savani

Differentiable Neural Architecture Search is one of the most popular Neural Architecture Search (NAS) methods for its search efficiency and simplicity, accomplished by jointly optimizing the model weight and architecture parameters in a…

Machine Learning · Computer Science 2021-08-11 Ruochen Wang , Minhao Cheng , Xiangning Chen , Xiaocheng Tang , Cho-Jui Hsieh

Neural architecture search can discover neural networks with good performance, and One-Shot approaches are prevalent. One-Shot approaches typically require a supernet with weight sharing and predictors that predict the performance of…

Machine Learning · Computer Science 2021-08-19 Chia-Hsiang Liu , Yu-Shin Han , Yuan-Yao Sung , Yi Lee , Hung-Yueh Chiang , Kai-Chiang Wu

Deep learning has proven to be a highly effective problem-solving tool for object detection and image segmentation across various domains such as healthcare and autonomous driving. At the heart of this performance lies neural architecture…

Machine Learning · Computer Science 2021-06-29 Robert Wu , Nayan Saxena , Rohan Jain

Recent one-shot Neural Architecture Search algorithms rely on training a hardware-agnostic super-network tailored to a specific task and then extracting efficient sub-networks for different hardware platforms. Popular approaches separate…

Machine Learning · Computer Science 2023-12-22 Sharath Nittur Sridhar , Maciej Szankin , Fang Chen , Sairam Sundaresan , Anthony Sarah

Monumental advances in deep learning have led to unprecedented achievements across various domains. While the performance of deep neural networks is indubitable, the architectural design and interpretability of such models are nontrivial.…

Machine Learning · Computer Science 2023-07-06 Zachariah Carmichael , Tim Moon , Sam Ade Jacobs

Binary Convolutional Neural Networks (CNNs) have significantly reduced the number of arithmetic operations and the size of memory storage needed for CNNs, which makes their deployment on mobile and embedded systems more feasible. However,…

Computer Vision and Pattern Recognition · Computer Science 2020-08-11 Baozhou Zhu , Zaid Al-Ars , Peter Hofstee

We study the robustness of data-centric methods to find neural network architectures, known as neural architecture search (NAS), against data poisoning. To audit this robustness, we design a poisoning framework that enables the systematic…

Machine Learning · Computer Science 2025-12-11 Zachary Coalson , Huazheng Wang , Qingyun Wu , Sanghyun Hong

Neural architecture search (NAS) with an accuracy predictor that predicts the accuracy of candidate architectures has drawn increasing attention due to its simplicity and effectiveness. Previous works usually employ neural network-based…

Machine Learning · Computer Science 2021-07-20 Renqian Luo , Xu Tan , Rui Wang , Tao Qin , Enhong Chen , Tie-Yan Liu

Evolutionary neural architecture search (ENAS) employs evolutionary algorithms to find high-performing neural architectures automatically, and has achieved great success. However, compared to the empirical success, its rigorous theoretical…

Neural and Evolutionary Computing · Computer Science 2024-04-09 Zeqiong Lv , Chao Qian , Yanan Sun

To reduce the human efforts in neural network design, Neural Architecture Search (NAS) has been applied with remarkable success to various high-level vision tasks such as classification and semantic segmentation. The underlying idea for the…

Computer Vision and Pattern Recognition · Computer Science 2020-10-27 Xuelian Cheng , Yiran Zhong , Mehrtash Harandi , Yuchao Dai , Xiaojun Chang , Tom Drummond , Hongdong Li , Zongyuan Ge

Neural architecture search (NAS) methods aim to automatically find the optimal deep neural network (DNN) architecture as measured by a given objective function, typically some combination of task accuracy and inference efficiency. For many…

Machine Learning · Computer Science 2021-10-29 Ravi Krishna , Aravind Kalaiah , Bichen Wu , Maxim Naumov , Dheevatsa Mudigere , Misha Smelyanskiy , Kurt Keutzer

Neural Architecture Search (NAS) has garnered significant research interest due to its capability to discover architectures superior to manually designed ones. Learning text representation is crucial for text classification and other…

The search space of neural architecture search (NAS) for convolutional neural network (CNN) is huge. To reduce searching cost, most NAS algorithms use fixed outer network level structure, and search the repeatable cell structure only. Such…

Computer Vision and Pattern Recognition · Computer Science 2020-08-14 Chunnan Wang , Hongzhi Wang , Guosheng Feng , Fei Geng

Neural Architecture Search (NAS) aims to optimize deep neural networks' architecture for better accuracy or smaller computational cost and has recently gained more research interests. Despite various successful approaches proposed to solve…

Machine Learning · Computer Science 2020-11-03 Bas van Stein , Hao Wang , Thomas Bäck