中文
相关论文

相关论文: Reinforced Evolutionary Neural Architecture Search

200 篇论文

A popular method for Neural Architecture Search (NAS) is based on growing networks via small local changes to the network's architecture called network morphisms. These methods start with a small seed network and progressively grow the…

机器学习 · 计算机科学 2024-11-12 Neal Lawton , Aram Galstyan , Greg Ver Steeg

Neural network architectures found by sophistic search algorithms achieve strikingly good test performance, surpassing most human-crafted network models by significant margins. Although computationally efficient, their design is often very…

机器学习 · 计算机科学 2021-04-23 Kevin Alexander Laube , Andreas Zell

The effectiveness of Evolutionary Neural Architecture Search (ENAS) is influenced by the design of the search space. Nevertheless, common methods including the global search space, scalable search space and hierarchical search space have…

神经与进化计算 · 计算机科学 2024-03-13 Juan Zou , Han Chu , Yizhang Xia , Junwen Xu , Yuan Liu , Zhanglu Hou

Single Image Super-Resolution (SISR) tasks have achieved significant performance with deep neural networks. However, the large number of parameters in CNN-based met-hods for SISR tasks require heavy computations. Although several efficient…

图像与视频处理 · 电气工程与系统科学 2022-12-20 Han Huang , Li Shen , Chaoyang He , Weisheng Dong , Wei Liu

Neural Architecture Search (NAS) methods autonomously discover high-accuracy neural network architectures, outperforming manually crafted ones. However, The NAS methods require high computational costs due to the high dimension search space…

神经与进化计算 · 计算机科学 2024-10-31 Zaniar Sharifi , Khabat Soltanian , Ali Amiri

This paper introduces a novel optimization method for differential neural architecture search, based on the theory of prediction with expert advice. Its optimization criterion is well fitted for an architecture-selection, i.e., it minimizes…

机器学习 · 计算机科学 2019-06-20 Niv Nayman , Asaf Noy , Tal Ridnik , Itamar Friedman , Rong Jin , Lihi Zelnik-Manor

Neural architecture search (NAS) promises to make deep learning accessible to non-experts by automating architecture engineering of deep neural networks. BANANAS is one state-of-the-art NAS method that is embedded within the Bayesian…

机器学习 · 计算机科学 2021-07-16 Lennart Schneider , Florian Pfisterer , Martin Binder , Bernd Bischl

Developing neural network image classification models often requires significant architecture engineering. In this paper, we study a method to learn the model architectures directly on the dataset of interest. As this approach is expensive…

计算机视觉与模式识别 · 计算机科学 2018-04-12 Barret Zoph , Vijay Vasudevan , Jonathon Shlens , Quoc V. Le

Different from other deep scalable architecture-based NAS approaches, Broad Neural Architecture Search (BNAS) proposes a broad scalable architecture which consists of convolution and enhancement blocks, dubbed Broad Convolutional Neural…

计算机视觉与模式识别 · 计算机科学 2022-08-02 Zixiang Ding , Yaran Chen , Nannan Li , Dongbin Zhao , C. L. Philip Chen

Neural architecture search (NAS) is a promising method for automatically design neural architectures. NAS adopts a search strategy to explore the predefined search space to find outstanding performance architecture with the minimum…

机器学习 · 计算机科学 2020-09-11 Chen Wei , Chuang Niu , Yiping Tang , Yue Wang , Haihong Hu , Jimin Liang

The traditional Neural Network-development process requires substantial expert knowledge and relies heavily on intuition and trial-and-error. Neural Architecture Search (NAS) frameworks were introduced to robustly search for network…

神经与进化计算 · 计算机科学 2023-06-16 Mohamed Shahawy , Elhadj Benkhelifa

The choice of neural network features can have a large impact on both the accuracy and speed of the network. Despite the current industry shift towards large transformer models, specialized binary classifiers remain critical for numerous…

神经与进化计算 · 计算机科学 2025-03-17 Benjamin David Winter , William John Teahan

In recent years, neural architecture search (NAS) has received intensive scientific and industrial interest due to its capability of finding a neural architecture with high accuracy for various artificial intelligence tasks such as image…

机器学习 · 计算机科学 2021-01-18 Martin Ferianc , Hongxiang Fan , Miguel Rodrigues

Techniques for automatically designing deep neural network architectures such as reinforcement learning based approaches have recently shown promising results. However, their success is based on vast computational resources (e.g. hundreds…

机器学习 · 计算机科学 2017-11-22 Han Cai , Tianyao Chen , Weinan Zhang , Yong Yu , Jun Wang

Evolutionary neural architecture search (ENAS) has recently received increasing attention by effectively finding high-quality neural architectures, which however consumes high computational cost by training the architecture encoded by each…

人工智能 · 计算机科学 2021-08-11 Shangshang Yang , Ye Tian , Xiaoshu Xiang , Shichen Peng , Xingyi Zhang

In class-incremental learning, a model learns continuously from a sequential data stream in which new classes occur. Existing methods often rely on static architectures that are manually crafted. These methods can be prone to capacity…

机器学习 · 计算机科学 2019-09-17 Shenyang Huang , Vincent François-Lavet , Guillaume Rabusseau

Neural architecture search (NAS) in expressive search spaces is a computationally hard problem, but it also holds the potential to automatically discover completely novel and performant architectures. To achieve this we need effective…

Neural Architecture Search (NAS), aiming at automatically designing network architectures by machines, is hoped and expected to bring about a new revolution in machine learning. Despite these high expectation, the effectiveness and…

计算机视觉与模式识别 · 计算机科学 2020-03-09 Changlin Li , Jiefeng Peng , Liuchun Yuan , Guangrun Wang , Xiaodan Liang , Liang Lin , Xiaojun Chang

We explore efficient neural architecture search methods and show that a simple yet powerful evolutionary algorithm can discover new architectures with excellent performance. Our approach combines a novel hierarchical genetic representation…

机器学习 · 计算机科学 2018-02-26 Hanxiao Liu , Karen Simonyan , Oriol Vinyals , Chrisantha Fernando , Koray Kavukcuoglu

Fast Neural Architecture Construction (NAC) is a method to construct deep network architectures by pruning and expansion of a base network. In recent years, several automated search methods for neural network architectures have been…

神经与进化计算 · 计算机科学 2018-12-17 Purushotham Kamath , Abhishek Singh , Debo Dutta