中文
相关论文

相关论文: Zero-Shot NAS via the Suppression of Local Entropy…

200 篇论文

Neural architecture search (NAS), an important branch of automatic machine learning, has become an effective approach to automate the design of deep learning models. However, the major issue in NAS is how to reduce the large search time…

机器学习 · 计算机科学 2021-07-15 Jae-hun Shim , Kyeongbo Kong , Suk-Ju Kang

Neural architecture search (NAS) enables the automatic design of neural network models. However, training the candidates generated by the search algorithm for performance evaluation incurs considerable computational overhead. Our method,…

机器学习 · 计算机科学 2025-06-23 Zhenhan Huang , Tejaswini Pedapati , Pin-Yu Chen , Chunheng Jiang , Jianxi Gao

Neural Architecture Search remains a very challenging meta-learning problem. Several recent techniques based on parameter-sharing idea have focused on reducing the NAS running time by leveraging proxy models, leading to architectures with…

机器学习 · 计算机科学 2022-02-08 Minsu Cho , Mohammadreza Soltani , Chinmay Hegde

An effective and efficient architecture performance evaluation scheme is essential for the success of Neural Architecture Search (NAS). To save computational cost, most of existing NAS algorithms often train and evaluate intermediate neural…

机器学习 · 计算机科学 2021-09-27 Yixing Xu , Yunhe Wang , Kai Han , Yehui Tang , Shangling Jui , Chunjing Xu , Chang Xu

Neural architecture search (NAS) has become increasingly popular in the deep learning community recently, mainly because it can provide an opportunity to allow interested users without rich expertise to benefit from the success of deep…

机器学习 · 计算机科学 2022-10-25 Shiqing Liu , Haoyu Zhang , Yaochu Jin

Neural Architecture Search (NAS) methods have been successfully applied to image tasks with excellent results. However, NAS methods are often complex and tend to converge to local minima as soon as generated architectures seem to yield good…

神经与进化计算 · 计算机科学 2022-08-16 Vasco Lopes , Miguel Santos , Bruno Degardin , Luís A. Alexandre

One-shot neural architecture search (NAS) substantially improves the search efficiency by training one supernet to estimate the performance of every possible child architecture (i.e., subnet). However, the inconsistency of characteristics…

计算机视觉与模式识别 · 计算机科学 2022-11-28 Xin He , Jiangchao Yao , Yuxin Wang , Zhenheng Tang , Ka Chu Cheung , Simon See , Bo Han , Xiaowen Chu

Resource is an important constraint when deploying Deep Neural Networks (DNNs) on mobile and edge devices. Existing works commonly adopt the cell-based search approach, which limits the flexibility of network patterns in learned cell…

机器学习 · 计算机科学 2020-03-04 Tunhou Zhang , Hsin-Pai Cheng , Zhenwen Li , Feng Yan , Chengyu Huang , Hai Li , Yiran Chen

Artificial neural networks have been shown to be state-of-the-art machine learning models in a wide variety of applications, including natural language processing and image recognition. However, building a performant neural network is a…

机器学习 · 计算机科学 2025-02-20 Raphael T. Husistein , Markus Reiher , Marco Eckhoff

The wide application of pre-trained models is driving the trend of once-for-all training in one-shot neural architecture search (NAS). However, training within a huge sample space damages the performance of individual subnets and requires…

网络与互联网体系结构 · 计算机科学 2023-06-19 Haibin Wang , Ce Ge , Hesen Chen , Xiuyu Sun

Neural architecture search (NAS) has seen a steep rise in interest over the last few years. Many algorithms for NAS consist of searching through a space of architectures by iteratively choosing an architecture, evaluating its performance by…

机器学习 · 计算机科学 2022-04-26 Colin White , Sam Nolen , Yash Savani

The search cost of neural architecture search (NAS) has been largely reduced by weight-sharing methods. These methods optimize a super-network with all possible edges and operations, and determine the optimal sub-network by discretization,…

计算机视觉与模式识别 · 计算机科学 2020-07-08 Yunjie Tian , Chang Liu , Lingxi Xie , Jianbin Jiao , Qixiang Ye

Neural Networks design is a complex and often daunting task, particularly for resource-constrained scenarios typical of mobile-sized models. Neural Architecture Search is a promising approach to automate this process, but existing…

计算机视觉与模式识别 · 计算机科学 2023-10-09 Niccolò Cavagnero , Luca Robbiano , Francesca Pistilli , Barbara Caputo , Giuseppe Averta

Neural Architecture Search (NAS) has been explosively studied to automate the discovery of top-performer neural networks. Current works require heavy training of supernet or intensive architecture evaluations, thus suffering from heavy…

计算机视觉与模式识别 · 计算机科学 2021-03-17 Wuyang Chen , Xinyu Gong , Zhangyang Wang

Neural architecture search (NAS) has fostered various fields of machine learning. Despite its prominent dedications, many have criticized the intrinsic limitations of high computational cost. We aim to ameliorate this by proposing a…

机器学习 · 计算机科学 2021-03-16 Kwanghee Choi , Minyoung Choe , Hyelee Lee

One of the primary challenges impeding the progress of Neural Architecture Search (NAS) is its extensive reliance on exorbitant computational resources. NAS benchmarks aim to simulate runs of NAS experiments at zero cost, remediating the…

机器学习 · 计算机科学 2024-06-19 Afzal Ahmad , Linfeng Du , Zhiyao Xie , Wei Zhang

In spite of the outstanding performance, Neural Architecture Search (NAS) is criticized for massive computation. Recently, Zero-shot NAS has emerged as a promising approach by exploiting Zero-cost (ZC) proxies, which markedly reduce…

计算与语言 · 计算机科学 2024-10-08 Peijie Dong , Lujun Li , Xiang Liu , Zhenheng Tang , Xuebo Liu , Qiang Wang , Xiaowen Chu

Neural architecture search (NAS) is a recent methodology for automating the design of neural network architectures. Differentiable neural architecture search (DARTS) is a promising NAS approach that dramatically increases search efficiency.…

机器学习 · 计算机科学 2021-04-22 Erik Bodin , Federico Tomasi , Zhenwen Dai

Neural Architecture Search (NAS) effectively discovers new Convolutional Neural Network (CNN) architectures, particularly for accuracy optimization. However, prior approaches often require resource-intensive training on super networks or…

机器学习 · 计算机科学 2024-01-18 Ye Qiao , Haocheng Xu , Yifan Zhang , Sitao Huang

Neural Architecture Search (NAS) often trains and evaluates a large number of architectures. Recent predictor-based NAS approaches attempt to alleviate such heavy computation costs with two key steps: sampling some architecture-performance…

机器学习 · 计算机科学 2021-11-04 Junru Wu , Xiyang Dai , Dongdong Chen , Yinpeng Chen , Mengchen Liu , Ye Yu , Zhangyang Wang , Zicheng Liu , Mei Chen , Lu Yuan