中文
相关论文

相关论文: Sample-Efficient Neural Architecture Search by Lea…

200 篇论文

Neural architecture search (NAS) relies on a good controller to generate better architectures or predict the accuracy of given architectures. However, training the controller requires both abundant and high-quality pairs of architectures…

机器学习 · 计算机科学 2020-11-04 Renqian Luo , Xu Tan , Rui Wang , Tao Qin , Enhong Chen , Tie-Yan Liu

The recent progress in neural architecture search (NAS) has allowed scaling the automated design of neural architectures to real-world domains, such as object detection and semantic segmentation. However, one prerequisite for the…

机器学习 · 计算机科学 2021-06-15 Thomas Elsken , Benedikt Staffler , Jan Hendrik Metzen , Frank Hutter

One of the key steps in Neural Architecture Search (NAS) is to estimate the performance of candidate architectures. Existing methods either directly use the validation performance or learn a predictor to estimate the performance. However,…

计算机视觉与模式识别 · 计算机科学 2021-04-07 Yaofo Chen , Yong Guo , Qi Chen , Minli Li , Wei Zeng , Yaowei Wang , Mingkui Tan

Differentiable neural architecture search (DNAS) is known for its capacity in the automatic generation of superior neural networks. However, DNAS based methods suffer from memory usage explosion when the search space expands, which may…

机器学习 · 计算机科学 2021-09-14 Zheyu Yan , Weiwen Jiang , Xiaobo Sharon Hu , Yiyu Shi

Neural Architecture Search (NAS), a framework which automates the task of designing neural networks, has recently been actively studied in the field of deep learning. However, there are only a few NAS methods suitable for 3D medical image…

图像与视频处理 · 电气工程与系统科学 2019-09-04 Woong Bae , Seungho Lee , Yeha Lee , Beomhee Park , Minki Chung , Kyu-Hwan Jung

Deep Neural Networks (DNNs) have the potential for making various clinical procedures more time-efficient by automating medical image segmentation. Due to their strong, in some cases human-level, performance, they have become the standard…

图像与视频处理 · 电气工程与系统科学 2022-02-24 Martijn M. A. Bosma , Arkadiy Dushatskiy , Monika Grewal , Tanja Alderliesten , Peter A. N. Bosman

Neural architecture search (NAS) has brought significant progress in recent image recognition tasks. Most existing NAS methods apply restricted search spaces, which limits the upper-bound performance of searched models. To address this…

机器学习 · 计算机科学 2022-12-06 Zimian Wei , Hengyue Pan , Lujun Li , Menglong Lu , Xin Niu , Peijie Dong , Dongsheng Li

The use of automatic methods, often referred to as Neural Architecture Search (NAS), in designing neural network architectures has recently drawn considerable attention. In this work, we present an efficient NAS approach, named HM- NAS,…

机器学习 · 计算机科学 2019-09-10 Shen Yan , Biyi Fang , Faen Zhang , Yu Zheng , Xiao Zeng , Hui Xu , Mi Zhang

Neural Architecture Search (NAS) has shown great potentials in automatically designing scalable network architectures for dense image predictions. However, existing NAS algorithms usually compromise on restricted search space and search on…

计算机视觉与模式识别 · 计算机科学 2021-03-30 Xiong Zhang , Hongmin Xu , Hong Mo , Jianchao Tan , Cheng Yang , Lei Wang , Wenqi Ren

The neural architecture search (NAS) algorithm with reinforcement learning can be a powerful and novel framework for the automatic discovering process of neural architectures. However, its application is restricted by noncontinuous and…

机器学习 · 计算机科学 2020-03-27 Chun-Ting Liu

While neural architecture search (NAS) has enabled automated machine learning (AutoML) for well-researched areas, its application to tasks beyond computer vision is still under-explored. As less-studied domains are precisely those where we…

机器学习 · 计算机科学 2022-10-11 Junhong Shen , Mikhail Khodak , Ameet Talwalkar

Neural Architecture Search (NAS) aims to optimize deep neural networks' architecture for better accuracy or smaller computational cost and has recently gained more research interests. Despite various successful approaches proposed to solve…

机器学习 · 计算机科学 2020-11-03 Bas van Stein , Hao Wang , Thomas Bäck

Architecture search optimizes the structure of a neural network for some task instead of relying on manual authoring. However, it is slow, as each potential architecture is typically trained from scratch. In this paper we present an…

机器学习 · 计算机科学 2021-10-08 Mohan Singamsetti , Anmol Mahajan , Matthew Guzdial

Neural network-based semantic segmentation has achieved remarkable results when large amounts of annotated data are available, that is, in the supervised case. However, such data is expensive to collect and so methods have been developed to…

计算机视觉与模式识别 · 计算机科学 2021-06-25 Xueqing Deng , Yi Zhu , Yuxin Tian , Shawn Newsam

Hardware-Aware Neural Architecture Search (HW-NAS) requires joint optimization of accuracy and latency under device constraints. Traditional supernet-based methods require multiple GPU days per dataset. Large Language Model (LLM)-driven…

机器学习 · 计算机科学 2025-12-08 Hengyi Zhu , Grace Li Zhang , Shaoyi Huang

Neural Architecture Search (NAS) often trains and evaluates a large number of architectures. Recent predictor-based NAS approaches attempt to alleviate such heavy computation costs with two key steps: sampling some architecture-performance…

机器学习 · 计算机科学 2021-11-04 Junru Wu , Xiyang Dai , Dongdong Chen , Yinpeng Chen , Mengchen Liu , Ye Yu , Zhangyang Wang , Zicheng Liu , Mei Chen , Lu Yuan

Neural Architecture Search (NAS) has shown great success in automating the design of neural networks, but the prohibitive amount of computations behind current NAS methods requires further investigations in improving the sample efficiency…

机器学习 · 计算机科学 2019-11-22 Linnan Wang , Yiyang Zhao , Yuu Jinnai , Yuandong Tian , Rodrigo Fonseca

Architecture search is the process of automatically learning the neural model or cell structure that best suits the given task. Recently, this approach has shown promising performance improvements (on language modeling and image…

计算与语言 · 计算机科学 2019-06-13 Ramakanth Pasunuru , Mohit Bansal

Recently, neural architecture search (NAS) methods have attracted much attention and outperformed manually designed architectures on a few high-level vision tasks. In this paper, we propose HiNAS (Hierarchical NAS), an effort towards…

计算机视觉与模式识别 · 计算机科学 2020-02-10 Haokui Zhang , Ying Li , Hao Chen , Chunhua Shen

Previous works on meta-learning either relied on elaborately hand-designed network structures or adopted specialized learning rules to a particular domain. We propose a universal framework to optimize the meta-learning process automatically…

机器学习 · 计算机科学 2019-09-10 Xinyue Zheng , Peng Wang , Qigang Wang , Zhongchao shi , Feiyu Xu