中文
相关论文

相关论文: Learn to Explore: Meta NAS via Bayesian Optimizati…

200 篇论文

In the past few years, neural architecture search (NAS) has become an increasingly important tool within the deep learning community. Despite the many recent successes of NAS, however, most existing approaches operate within highly…

机器学习 · 计算机科学 2022-11-14 Charles Jin , Phitchaya Mangpo Phothilimthana , Sudip Roy

Graph neural architecture search (NAS) has gained popularity in automatically designing powerful graph neural networks (GNNs) with relieving human efforts. However, existing graph NAS methods mainly work under the homophily assumption and…

机器学习 · 计算机科学 2023-02-27 Xin Zheng , Miao Zhang , Chunyang Chen , Qin Zhang , Chuan Zhou , Shirui Pan

Networks found with Neural Architecture Search (NAS) achieve state-of-the-art performance in a variety of tasks, out-performing human-designed networks. However, most NAS methods heavily rely on human-defined assumptions that constrain the…

计算机视觉与模式识别 · 计算机科学 2023-01-10 Vasco Lopes , Luís A. Alexandre

Neural architecture search (NAS) for Graph neural networks (GNNs), called NAS-GNNs, has achieved significant performance over manually designed GNN architectures. However, these methods inherit issues from the conventional NAS methods, such…

机器学习 · 计算机科学 2023-06-19 Peng Xu , Lin Zhang , Xuanzhou Liu , Jiaqi Sun , Yue Zhao , Haiqin Yang , Bei Yu

Traditional neural architecture search (NAS) has a significant impact in computer vision by automatically designing network architectures for various tasks. In this paper, binarized neural architecture search (BNAS), with a search space of…

计算机视觉与模式识别 · 计算机科学 2020-09-10 Hanlin Chen , Li'an Zhuo , Baochang Zhang , Xiawu Zheng , Jianzhuang Liu , Rongrong Ji , David Doermann , Guodong Guo

Graph Neural Architecture Search (GNAS) has shown promising results in finding the best graph neural network architecture on a given graph dataset. However, existing GNAS methods still require intensive human labor and rich domain knowledge…

机器学习 · 计算机科学 2025-10-28 Haishuai Wang , Yang Gao , Xin Zheng , Peng Zhang , Jiajun Bu , Philip S. Yu

Binary Neural Networks (BNNs) have gained extensive attention for their superior inferencing efficiency and compression ratio compared to traditional full-precision networks. However, due to the unique characteristics of BNNs, designing a…

计算机视觉与模式识别 · 计算机科学 2024-08-29 Zhihao Lin , Yongtao Wang , Jinhe Zhang , Xiaojie Chu , Haibin Ling

The key challenge in neural architecture search (NAS) is designing how to explore wisely in the huge search space. We propose a new NAS method called TNAS (NAS with trees), which improves search efficiency by exploring only a small number…

人工智能 · 计算机科学 2022-04-12 Guocheng Qian , Xuanyang Zhang , Guohao Li , Chen Zhao , Yukang Chen , Xiangyu Zhang , Bernard Ghanem , Jian Sun

We propose a novel strategy for Neural Architecture Search (NAS) based on Bregman iterations. Starting from a sparse neural network our gradient-based one-shot algorithm gradually adds relevant parameters in an inverse scale space manner.…

机器学习 · 计算机科学 2021-06-07 Leon Bungert , Tim Roith , Daniel Tenbrinck , Martin Burger

Neural Architecture Search (NAS) is a collection of methods to craft the way neural networks are built. Current NAS methods are far from ab initio and automatic, as they use manual backbone architectures or micro building blocks (cells),…

机器学习 · 计算机科学 2020-10-20 Anubhav Garg , Amit Kumar Saha , Debo Dutta

Neural architecture search (NAS) has shown promise towards automating neural network design for a given task, but it is computationally demanding due to training costs associated with evaluating a large number of architectures to find the…

计算机视觉与模式识别 · 计算机科学 2025-02-07 Shahid Siddiqui , Christos Kyrkou , Theocharis Theocharides

Neural Architecture Search (NAS) has emerged as a key tool in identifying optimal configurations of deep neural networks tailored to specific tasks. However, training and assessing numerous architectures introduces considerable…

机器学习 · 计算机科学 2024-04-25 Haoming Zhang , Ran Cheng

Neural Architecture Search (NAS) automates and prospers the design of neural networks. Estimator-based NAS has been proposed recently to model the relationship between architectures and their performance to enable scalable and flexible…

人工智能 · 计算机科学 2020-09-29 Hsin-Pai Cheng , Tunhou Zhang , Yixing Zhang , Shiyu Li , Feng Liang , Feng Yan , Meng Li , Vikas Chandra , Hai Li , Yiran Chen

We propose Stochastic Neural Architecture Search (SNAS), an economical end-to-end solution to Neural Architecture Search (NAS) that trains neural operation parameters and architecture distribution parameters in same round of…

机器学习 · 计算机科学 2020-04-02 Sirui Xie , Hehui Zheng , Chunxiao Liu , Liang Lin

Neural architecture search (NAS) enables the automatic design of neural network models. However, training the candidates generated by the search algorithm for performance evaluation incurs considerable computational overhead. Our method,…

机器学习 · 计算机科学 2025-06-23 Zhenhan Huang , Tejaswini Pedapati , Pin-Yu Chen , Chunheng Jiang , Jianxi Gao

Neural Architecture Search (NAS) algorithms automate the task of finding optimal deep learning architectures given an initial search space of possible operations. Developing these search spaces is usually a manual affair with pre-optimized…

机器学习 · 计算机科学 2021-11-08 Robert Wu , Nayan Saxena , Rohan Jain

Neural architecture search (NAS) aims to automatically design deep neural networks of satisfactory performance. Wherein, architecture performance predictor is critical to efficiently value an intermediate neural architecture. But for the…

计算机视觉与模式识别 · 计算机科学 2020-10-16 Yehui Tang , Yunhe Wang , Yixing Xu , Hanting Chen , Chunjing Xu , Boxin Shi , Chao Xu , Qi Tian , Chang Xu

Current neural architecture search (NAS) strategies focus only on finding a single, good, architecture. They offer little insight into why a specific network is performing well, or how we should modify the architecture if we want further…

机器学习 · 计算机科学 2021-02-22 Binxin Ru , Xingchen Wan , Xiaowen Dong , Michael Osborne

Neural Architecture Search (NAS) aims to automatically find effective architectures within a predefined search space. However, the search space is often extremely large. As a result, directly searching in such a large search space is…

计算机视觉与模式识别 · 计算机科学 2024-06-07 Yaofo Chen , Yong Guo , Daihai Liao , Fanbing Lv , Hengjie Song , James Tin-Yau Kwok , Mingkui Tan

Most conventional Neural Architecture Search (NAS) approaches are limited in that they only generate architectures without searching for the optimal parameters. While some NAS methods handle this issue by utilizing a supernet trained on a…

机器学习 · 计算机科学 2021-10-29 Wonyong Jeong , Hayeon Lee , Gun Park , Eunyoung Hyung , Jinheon Baek , Sung Ju Hwang