English
Related papers

Related papers: Efficient Re-parameterization Operations Search fo…

200 papers

Neural Architecture Search (NAS) has shown excellent results in designing architectures for computer vision problems. NAS alleviates the need for human-defined settings by automating architecture design and engineering. However, NAS methods…

Machine Learning · Computer Science 2021-10-29 Vasco Lopes , Saeid Alirezazadeh , Luís A. Alexandre

Techniques for automatically designing deep neural network architectures such as reinforcement learning based approaches have recently shown promising results. However, their success is based on vast computational resources (e.g. hundreds…

Machine Learning · Computer Science 2017-11-22 Han Cai , Tianyao Chen , Weinan Zhang , Yong Yu , Jun Wang

The hyper-parameters of a neural network are traditionally designed through a time consuming process of trial and error that requires substantial expert knowledge. Neural Architecture Search (NAS) algorithms aim to take the human out of the…

Neural and Evolutionary Computing · Computer Science 2021-06-01 Andrew Nader , Danielle Azar

Network Architecture Search (NAS) methods have recently gathered much attention. They design networks with better performance and use a much shorter search time compared to traditional manual tuning. Despite their efficiency in model…

Machine Learning · Computer Science 2021-09-13 Yiren Zhao , Xitong Gao , Ilia Shumailov , Nicolo Fusi , Robert Mullins

We propose a scalable framework for the learning of high-dimensional parametric maps via adaptively constructed residual network (ResNet) maps between reduced bases of the inputs and outputs. When just few training data are available, it is…

There is a growing interest in automated neural architecture search (NAS) methods. They are employed to routinely deliver high-quality neural network architectures for various challenging data sets and reduce the designer's effort. The NAS…

Neural and Evolutionary Computing · Computer Science 2022-06-28 Michal Pinos , Vojtech Mrazek , Lukas Sekanina

Neural Architecture Search (NAS) continues to serve a key roll in the design and development of neural networks for task specific deployment. Modern NAS techniques struggle to deal with ever increasing search space complexity and compute…

Computer Vision and Pattern Recognition · Computer Science 2024-11-25 Arjun Sridhar , Yiran Chen

Neural architecture search (NAS) can have a significant impact in computer vision by automatically designing optimal neural network architectures for various tasks. A variant, binarized neural architecture search (BNAS), with a search space…

Computer Vision and Pattern Recognition · Computer Science 2020-02-12 Hanlin Chen , Li'an Zhuo , Baochang Zhang , Xiawu Zheng , Jianzhuang Liu , David Doermann , Rongrong Ji

Semantic segmentation is a popular research topic in computer vision, and many efforts have been made on it with impressive results. In this paper, we intend to search an optimal network structure that can run in real-time for this problem.…

Computer Vision and Pattern Recognition · Computer Science 2022-08-11 Peng Ye , Baopu Li , Tao Chen , Jiayuan Fan , Zhen Mei , Chen Lin , Chongyan Zuo , Qinghua Chi , Wanli Ouyan

Neural architecture search (NAS) aims to automatically design deep neural networks of satisfactory performance. Wherein, architecture performance predictor is critical to efficiently value an intermediate neural architecture. But for the…

Computer Vision and Pattern Recognition · Computer Science 2020-10-16 Yehui Tang , Yunhe Wang , Yixing Xu , Hanting Chen , Chunjing Xu , Boxin Shi , Chao Xu , Qi Tian , Chang Xu

In this paper, we propose Efficient Progressive Neural Architecture Search (EPNAS), a neural architecture search (NAS) that efficiently handles large search space through a novel progressive search policy with performance prediction based…

Machine Learning · Computer Science 2019-07-11 Yanqi Zhou , Peng Wang , Sercan Arik , Haonan Yu , Syed Zawad , Feng Yan , Greg Diamos

For the goal of automated design of high-performance deep convolutional neural networks (CNNs), Neural Architecture Search (NAS) methodology is becoming increasingly important for both academia and industries.Due to the costly stochastic…

Machine Learning · Computer Science 2021-10-12 Shengran Hu , Ran Cheng , Cheng He , Zhichao Lu , Jing Wang , Miao Zhang

Recurrent neural networks are good at solving prediction problems. However, finding a network that suits a problem is quite hard because their performance is strongly affected by their architecture configuration. Automatic architecture…

Neural and Evolutionary Computing · Computer Science 2021-03-16 Andrés Camero , Jamal Toutouh , Enrique Alba

Neural architecture search (NAS), the study of automating the discovery of optimal deep neural network architectures for tasks in domains such as computer vision and natural language processing, has seen rapid growth in the machine learning…

Neural and Evolutionary Computing · Computer Science 2022-03-01 Daniel Cummings , Sharath Nittur Sridhar , Anthony Sarah , Maciej Szankin

Existing neural networks are memory-consuming and computationally intensive, making deploying them challenging in resource-constrained environments. However, there are various methods to improve their efficiency. Two such methods are…

Machine Learning · Computer Science 2023-11-10 Anastasiia Prutianova , Alexey Zaytsev , Chung-Kuei Lee , Fengyu Sun , Ivan Koryakovskiy

Developing neural network image classification models often requires significant architecture engineering. In this paper, we study a method to learn the model architectures directly on the dataset of interest. As this approach is expensive…

Computer Vision and Pattern Recognition · Computer Science 2018-04-12 Barret Zoph , Vijay Vasudevan , Jonathon Shlens , Quoc V. Le

Convolution Neural Networks, known as ConvNets exceptionally perform well in many complex machine learning tasks. The architecture of ConvNets demands the huge and rich amount of data and involves with a vast number of parameters that leads…

Computer Vision and Pattern Recognition · Computer Science 2017-12-14 Pushparaja Murugan , Shanmugasundaram Durairaj

Neural architecture search (NAS) has been an active direction of automatic machine learning (Auto-ML), aiming to explore efficient network structures. The searched architecture is evaluated by training on datasets with fixed data…

Machine Learning · Computer Science 2022-01-31 Xiaoxing Wang , Xiangxiang Chu , Junchi Yan , Xiaokang Yang

Neural architecture search (NAS) has recently reshaped our understanding on various vision tasks. Similar to the success of NAS in high-level vision tasks, it is possible to find a memory and computationally efficient solution via NAS with…

Image and Video Processing · Electrical Eng. & Systems 2021-04-07 Qian Ning , Weisheng Dong , Xin Li , Jinjian Wu , Leida Li , Guangming Shi

We propose a novel neural architecture search algorithm via reinforcement learning by decoupling structure and operation search processes. Our approach samples candidate models from the multinomial distribution on the policy vectors defined…

Machine Learning · Computer Science 2020-04-28 Heung-Chang Lee , Do-Guk Kim , Bohyung Han