中文
相关论文

相关论文: A Survey on Neural Architecture Search Based on Re…

200 篇论文

Neural Architecture Search is a costly practice. The fact that a search space can span a vast number of design choices with each architecture evaluation taking nontrivial overhead makes it hard for an algorithm to sufficiently explore…

计算机视觉与模式识别 · 计算机科学 2024-03-21 Keith G. Mills , Fred X. Han , Mohammad Salameh , Shengyao Lu , Chunhua Zhou , Jiao He , Fengyu Sun , Di Niu

In this publication, we assess the ability of a novel Reinforcement Learning-based solution to the problem of Neural Architecture Search, where a Reinforcement Learning (RL) agent learns to search for good architectures, rather than to…

机器学习 · 计算机科学 2024-12-20 Amber Cassimon , Siegfried Mercelis , Kevin Mets

In neural architecture search, the structure of the neural network to best model a given dataset is determined by an automated search process. Efficient Neural Architecture Search (ENAS), proposed by Pham et al. (2018), has recently…

机器学习 · 计算机科学 2019-06-19 Prabhant Singh , Tobias Jacobs , Sebastien Nicolas , Mischa Schmidt

This paper represents the first effort to explore an automated architecture search for hyperdimensional computing (HDC), a type of brain-inspired neural network. Currently, HDC design is largely carried out in an application-specific ad-hoc…

机器学习 · 计算机科学 2022-02-14 Junhuan Yang , Yi Sheng , Sizhe Zhang , Ruixuan Wang , Kenneth Foreman , Mikell Paige , Xun Jiao , Weiwen Jiang , Lei Yang

Machine learning has made tremendous progress in recent years and received large amounts of public attention. Though we are still far from designing a full artificially intelligent agent, machine learning has brought us many applications in…

机器学习 · 计算机科学 2019-08-29 Steven Abreu

The history of deep learning has shown that human-designed problem-specific networks can greatly improve the classification performance of general neural models. In most practical cases, however, choosing the optimal architecture for a…

机器学习 · 计算机科学 2020-09-14 Nicolo Colombo , Yang Gao

The time and effort involved in hand-designing deep neural networks is immense. This has prompted the development of Neural Architecture Search (NAS) techniques to automate this design. However, NAS algorithms tend to be slow and expensive;…

机器学习 · 计算机科学 2021-06-14 Joseph Mellor , Jack Turner , Amos Storkey , Elliot J. Crowley

Automatic neural architecture design has shown its potential in discovering powerful neural network architectures. Existing methods, no matter based on reinforcement learning or evolutionary algorithms (EA), conduct architecture search in a…

机器学习 · 计算机科学 2019-09-05 Renqian Luo , Fei Tian , Tao Qin , Enhong Chen , Tie-Yan Liu

Data-driven methods have made great progress in fault diagnosis, especially deep learning method. Deep learning is suitable for processing big data, and has a strong feature extraction ability to realize end-to-end fault diagnosis systems.…

机器学习 · 计算机科学 2020-02-20 Xudong Li , Yang Hu , Jianhua Zheng , Mingtao Li

Neural Architecture Search (NAS) is a research field concerned with utilizing optimization algorithms to design optimal neural network architectures. There are many approaches concerning the architectural search spaces, optimization…

机器学习 · 计算机科学 2020-05-25 George Kyriakides , Konstantinos Margaritis

Recent studies on automatic neural architectures search have demonstrated significant performance, competitive to or even better than hand-crafted neural architectures. However, most of the existing network architecture tend to use…

机器学习 · 计算机科学 2020-06-12 Peiye Liu , Bo Wu , Huadong Ma , Mingoo Seok

Neural Architecture Search (NAS) enabled the discovery of state-of-the-art architectures in many domains. However, the success of NAS depends on the definition of the search space. Current search spaces are defined as a static sequence of…

Current neural architecture search (NAS) algorithms still require expert knowledge and effort to design a search space for network construction. In this paper, we consider automating the search space design to minimize human interference,…

计算机视觉与模式识别 · 计算机科学 2021-03-23 Daquan Zhou , Xiaojie Jin , Xiaochen Lian , Linjie Yang , Yujing Xue , Qibin Hou , Jiashi Feng

Optimizing a neural network's performance is a tedious and time taking process, this iterative process does not have any defined solution which can work for all the problems. Optimization can be roughly categorized into - Architecture and…

机器学习 · 计算机科学 2019-12-16 Siddhartha Dhar Choudhury , Shashank Pandey , Kunal Mehrotra

The recent progress of deep convolutional neural networks has enabled great success in single image super-resolution (SISR) and many other vision tasks. Their performances are also being increased by deepening the networks and developing…

计算机视觉与模式识别 · 计算机科学 2021-04-20 Joon Young Ahn , Nam Ik Cho

A problem related to the development of algorithms designed to find the structure of artificial neural network used for behavioural (black-box) modelling of selected dynamic processes has been addressed in this paper. The research has…

神经与进化计算 · 计算机科学 2023-09-26 Krzysztof Laddach , Rafał Łangowski , Tomasz A. Rutkowski , Bartosz Puchalski

Almost all neural architecture search methods are evaluated in terms of performance (i.e. test accuracy) of the model structures that it finds. Should it be the only metric for a good autoML approach? To examine aspects beyond performance,…

机器学习 · 计算机科学 2020-03-04 Stefano Alletto , Shenyang Huang , Vincent Francois-Lavet , Yohei Nakata , Guillaume Rabusseau

Neural Architecture Search (NAS) for automatically finding the optimal network architecture has shown some success with competitive performances in various computer vision tasks. However, NAS in general requires a tremendous amount of…

计算机视觉与模式识别 · 计算机科学 2022-12-14 Bokyeung Lee , Kyungdeuk Ko , Jonghwan Hong , Hanseok Ko

Graph neural networks (GNN) has been successfully applied to operate on the graph-structured data. Given a specific scenario, rich human expertise and tremendous laborious trials are usually required to identify a suitable GNN architecture.…

机器学习 · 计算机科学 2019-09-11 Kaixiong Zhou , Qingquan Song , Xiao Huang , Xia Hu

Finding a well-performing architecture is often tedious for both DL practitioners and researchers, leading to tremendous interest in the automation of this task by means of neural architecture search (NAS). Although the community has made…

机器学习 · 计算机科学 2020-11-04 Marius Lindauer , Frank Hutter