中文
相关论文

相关论文: Neural Network Design: Learning from Neural Archit…

200 篇论文

Neural architecture search (NAS) is a promising method for automatically design neural architectures. NAS adopts a search strategy to explore the predefined search space to find outstanding performance architecture with the minimum…

机器学习 · 计算机科学 2020-09-11 Chen Wei , Chuang Niu , Yiping Tang , Yue Wang , Haihong Hu , Jimin Liang

Neural Architecture Search (NAS) has emerged as one of the effective methods to design the optimal neural network architecture automatically. Although neural architectures have achieved human-level performances in several tasks, few of them…

计算机视觉与模式识别 · 计算机科学 2025-02-18 Caiyang Yu , Xianggen Liu , Yifan Wang , Yun Liu , Wentao Feng , Deng Xiong , Chenwei Tang , Jiancheng Lv

Neural Architecture Search (NAS) is a collection of methods to craft the way neural networks are built. Current NAS methods are far from ab initio and automatic, as they use manual backbone architectures or micro building blocks (cells),…

机器学习 · 计算机科学 2020-10-20 Anubhav Garg , Amit Kumar Saha , Debo Dutta

Neural Architecture Search (NAS) methods have been successfully applied to image tasks with excellent results. However, NAS methods are often complex and tend to converge to local minima as soon as generated architectures seem to yield good…

神经与进化计算 · 计算机科学 2022-08-16 Vasco Lopes , Miguel Santos , Bruno Degardin , Luís A. Alexandre

Adequate labeled data and expensive compute resources are the prerequisites for the success of neural architecture search(NAS). It is challenging to apply NAS in meta-learning scenarios with limited compute resources and data. In this…

机器学习 · 计算机科学 2021-10-13 Jingtao Rong , Xinyi Yu , Mingyang Zhang , Linlin Ou

Recent advances in adversarial attacks show the vulnerability of deep neural networks searched by Neural Architecture Search (NAS). Although NAS methods can find network architectures with the state-of-the-art performance, the adversarial…

机器学习 · 计算机科学 2020-11-20 Zhixiong Yue , Baijiong Lin , Xiaonan Huang , Yu Zhang

As we advance in the fast-growing era of Machine Learning, various new and more complex neural architectures are arising to tackle problem more efficiently. On the one hand their efficient usage requires advanced knowledge and expertise,…

机器学习 · 计算机科学 2023-10-30 Léo Pouy , Fouad Khenfri , Patrick Leserf , Chokri Mraidha , Cherif Larouci

While neural architecture search (NAS) has enabled automated machine learning (AutoML) for well-researched areas, its application to tasks beyond computer vision is still under-explored. As less-studied domains are precisely those where we…

机器学习 · 计算机科学 2022-10-11 Junhong Shen , Mikhail Khodak , Ameet Talwalkar

Knowledge of search-landscape features of BlackBox Optimization (BBO) problems offers valuable information in light of the Algorithm Selection and/or Configuration problems. Exploratory Landscape Analysis (ELA) models have gained success in…

人工智能 · 计算机科学 2022-06-29 Boris Yazmir , Ofer M. Shir

There are many research works on the designing of architectures for the deep neural networks (DNN), which are named neural architecture search (NAS) methods. Although there are many automatic and manual techniques for NAS problems, there is…

计算机视觉与模式识别 · 计算机科学 2020-01-01 Emad Malekhosseini , Mohsen Hajabdollahi , Nader Karimi , Shadrokh Samavi

In the past few years, neural architecture search (NAS) has become an increasingly important tool within the deep learning community. Despite the many recent successes of NAS, however, most existing approaches operate within highly…

机器学习 · 计算机科学 2022-11-14 Charles Jin , Phitchaya Mangpo Phothilimthana , Sudip Roy

The neural architecture search (NAS) algorithm with reinforcement learning can be a powerful and novel framework for the automatic discovering process of neural architectures. However, its application is restricted by noncontinuous and…

机器学习 · 计算机科学 2020-03-27 Chun-Ting Liu

Neural Architecture Search (NAS) has received increasing attention because of its exceptional merits in automating the design of Deep Neural Network (DNN) architectures. However, the performance evaluation process, as a key part of NAS,…

神经与进化计算 · 计算机科学 2024-10-10 Xiaotian Song , Xiangning Xie , Zeqiong Lv , Gary G. Yen , Weiping Ding , Jiancheng Lv , Yanan Sun

Neural Architecture Search (NAS) represents a class of methods to generate the optimal neural network architecture and typically iterate over candidate architectures till convergence over some particular metric like validation loss. They…

机器学习 · 计算机科学 2019-10-22 Abhishek Singh , Anubhav Garg , Jinan Zhou , Shiv Ram Dubey , Debo Dutta

Neural Architectures Search (NAS) becomes more and more popular over these years. However, NAS-generated models tends to suffer greater vulnerability to various malicious attacks. Lots of robust NAS methods leverage adversarial training to…

机器学习 · 计算机科学 2023-04-11 Xunyu Zhu , Jian Li , Yong Liu , Weiping Wang

Neural architecture search has shown its great potential in various areas recently. However, existing methods rely heavily on a black-box controller to search architectures, which suffers from the serious problem of lacking…

机器学习 · 计算机科学 2020-09-29 Xinyue Zheng , Peng Wang , Qigang Wang , Zhongchao Shi

Neural Architecture Search (NAS) benchmarks significantly improved the capability of developing and comparing NAS methods while at the same time drastically reduced the computational overhead by providing meta-information about thousands of…

机器学习 · 计算机科学 2023-03-31 Vasco Lopes , Bruno Degardin , Luís A. Alexandre

Traditional neural architecture search (NAS) has a significant impact in computer vision by automatically designing network architectures for various tasks. In this paper, binarized neural architecture search (BNAS), with a search space of…

计算机视觉与模式识别 · 计算机科学 2020-09-10 Hanlin Chen , Li'an Zhuo , Baochang Zhang , Xiawu Zheng , Jianzhuang Liu , Rongrong Ji , David Doermann , Guodong Guo

To achieve excellent performance with modern neural networks, having the right network architecture is important. Neural Architecture Search (NAS) concerns the automatic discovery of task-specific network architectures. Modern NAS…

计算机视觉与模式识别 · 计算机科学 2022-04-29 Alexander Chebykin , Tanja Alderliesten , Peter A. N. Bosman

Continual learning with neural networks is an important learning framework in AI that aims to learn a sequence of tasks well. However, it is often confronted with three challenges: (1) overcome the catastrophic forgetting problem, (2) adapt…

机器学习 · 计算机科学 2020-06-11 Qiang Gao , Zhipeng Luo , Diego Klabjan