English
Related papers

Related papers: Poisoning the Search Space in Neural Architecture …

200 papers

Neural Architecture Search (NAS) is a powerful tool for automating effective image processing DNN designing. The ranking has been advocated to design an efficient performance predictor for NAS. The previous contrastive method solves the…

Computer Vision and Pattern Recognition · Computer Science 2022-07-13 Bicheng Guo , Tao Chen , Shibo He , Haoyu Liu , Lilin Xu , Peng Ye , Jiming Chen

By the widespread popularity of electronic devices, the emergence of biometric technology has brought significant convenience to user authentication compared with the traditional password and mode unlocking. Among many biological…

Computer Vision and Pattern Recognition · Computer Science 2019-04-29 Ning Zhu

Neural architecture search (NAS) is a hard computationally expensive optimization problem with a discrete, vast, and spiky search space. One of the key research efforts dedicated to this space focuses on accelerating NAS via certain proxy…

Machine Learning · Computer Science 2025-09-09 Bo Lyu , Yu Cui , Tuo Shi , Ke Li

The design of handcrafted neural networks requires a lot of time and resources. Recent techniques in Neural Architecture Search (NAS) have proven to be competitive or better than traditional handcrafted design, although they require domain…

Machine Learning · Computer Science 2021-03-17 Cat P. Le , Mohammadreza Soltani , Robert Ravier , Vahid Tarokh

Architecture search is the process of automatically learning the neural model or cell structure that best suits the given task. Recently, this approach has shown promising performance improvements (on language modeling and image…

Computation and Language · Computer Science 2019-06-13 Ramakanth Pasunuru , Mohit Bansal

Recent years have witnessed a surging interest in Neural Architecture Search (NAS). Various algorithms have been proposed to improve the search efficiency and effectiveness of NAS, i.e., to reduce the search cost and improve the…

Machine Learning · Computer Science 2022-04-26 Yao Shu , Shaofeng Cai , Zhongxiang Dai , Beng Chin Ooi , Bryan Kian Hsiang Low

This paper addresses the efficiency challenge of Neural Architecture Search (NAS) by formulating the task as a ranking problem. Previous methods require numerous training examples to estimate the accurate performance of architectures,…

Computation and Language · Computer Science 2021-09-20 Chi Hu , Chenglong Wang , Xiangnan Ma , Xia Meng , Yinqiao Li , Tong Xiao , Jingbo Zhu , Changliang Li

One of the key steps in Neural Architecture Search (NAS) is to estimate the performance of candidate architectures. Existing methods either directly use the validation performance or learn a predictor to estimate the performance. However,…

Computer Vision and Pattern Recognition · Computer Science 2021-04-07 Yaofo Chen , Yong Guo , Qi Chen , Minli Li , Wei Zeng , Yaowei Wang , Mingkui Tan

The performance of a deep neural network is heavily dependent on its architecture and various neural architecture search strategies have been developed for automated network architecture design. Recently, evolutionary neural architecture…

Neural and Evolutionary Computing · Computer Science 2020-03-27 Haoyu Zhang , Yaochu Jin , Ran Cheng , Kuangrong Hao

This survey paper presents a comprehensive examination of Spiking Neural Network (SNN) architecture search (SNNaS) from a unique hardware/software co-design perspective. SNNs, inspired by biological neurons, have emerged as a promising…

Neural and Evolutionary Computing · Computer Science 2026-04-06 Kama Svoboda , Tosiron Adegbija

The Neural Architecture Search (NAS) problem is typically formulated as a graph search problem where the goal is to learn the optimal operations over edges in order to maximise a graph-level global objective. Due to the large architecture…

Computer Vision and Pattern Recognition · Computer Science 2023-01-13 Vasco Lopes , Fabio Maria Carlucci , Pedro M Esperança , Marco Singh , Victor Gabillon , Antoine Yang , Hang Xu , Zewei Chen , Jun Wang

Neural network-based semantic segmentation has achieved remarkable results when large amounts of annotated data are available, that is, in the supervised case. However, such data is expensive to collect and so methods have been developed to…

Computer Vision and Pattern Recognition · Computer Science 2021-06-25 Xueqing Deng , Yi Zhu , Yuxin Tian , Shawn Newsam

Bayesian Neural Networks (BNNs) offer a mathematically grounded framework to quantify the uncertainty of model predictions but come with a prohibitive computation cost for both training and inference. In this work, we show a novel network…

Machine Learning · Computer Science 2022-02-10 Duo Wang , Yiren Zhao , Ilia Shumailov , Robert Mullins

Techniques for automatically designing deep neural network architectures such as reinforcement learning based approaches have recently shown promising results. However, their success is based on vast computational resources (e.g. hundreds…

Machine Learning · Computer Science 2017-11-22 Han Cai , Tianyao Chen , Weinan Zhang , Yong Yu , Jun Wang

Neural architecture search (NAS) methods aim to automatically find the optimal deep neural network (DNN) architecture as measured by a given objective function, typically some combination of task accuracy and inference efficiency. For many…

Machine Learning · Computer Science 2021-10-29 Ravi Krishna , Aravind Kalaiah , Bichen Wu , Maxim Naumov , Dheevatsa Mudigere , Misha Smelyanskiy , Kurt Keutzer

Reinforcement learning (RL) is a goal-oriented learning solution that has proven to be successful for Neural Architecture Search (NAS) on the CIFAR and ImageNet datasets. However, a limitation of this approach is its high computational…

Neural and Evolutionary Computing · Computer Science 2019-12-04 J. Gomez Robles , J. Vanschoren

Neural Architecture Search (NAS) is a promising and rapidly evolving research area. Training a large number of neural networks requires an exceptional amount of computational power, which makes NAS unreachable for those researchers who have…

Machine Learning · Computer Science 2020-06-15 Nikita Klyuchnikov , Ilya Trofimov , Ekaterina Artemova , Mikhail Salnikov , Maxim Fedorov , Evgeny Burnaev

AI technology has made remarkable achievements in computational pathology (CPath), especially with the help of deep neural networks. However, the network performance is highly related to architecture design, which commonly requires human…

Computer Vision and Pattern Recognition · Computer Science 2021-08-17 Sheyang Tang , Mahdi S. Hosseini , Lina Chen , Sonal Varma , Corwyn Rowsell , Savvas Damaskinos , Konstantinos N. Plataniotis , Zhou Wang

Machine learning promotes the continuous development of signal processing in various fields, including network traffic monitoring, EEG classification, face identification, and many more. However, massive user data collected for training…

Cryptography and Security · Computer Science 2022-04-26 Fuyi Wang , Leo Yu Zhang , Lei Pan , Shengshan Hu , Robin Doss

Most conventional Neural Architecture Search (NAS) approaches are limited in that they only generate architectures without searching for the optimal parameters. While some NAS methods handle this issue by utilizing a supernet trained on a…

Machine Learning · Computer Science 2021-10-29 Wonyong Jeong , Hayeon Lee , Gun Park , Eunyoung Hyung , Jinheon Baek , Sung Ju Hwang