中文
相关论文

相关论文: Learn to Explore: Meta NAS via Bayesian Optimizati…

200 篇论文

Differentiable Neural Architecture Search (NAS) provides efficient, gradient-based methods for automatically designing neural networks, yet its adoption remains limited in practice. We present MIDAS, a novel approach that modernizes DARTS…

机器学习 · 计算机科学 2026-02-23 Konstanty Subbotko

As we advance in the fast-growing era of Machine Learning, various new and more complex neural architectures are arising to tackle problem more efficiently. On the one hand their efficient usage requires advanced knowledge and expertise,…

机器学习 · 计算机科学 2023-10-30 Léo Pouy , Fouad Khenfri , Patrick Leserf , Chokri Mraidha , Cherif Larouci

Neural Architecture Search (NAS), aiming at automatically designing network architectures by machines, is hoped and expected to bring about a new revolution in machine learning. Despite these high expectation, the effectiveness and…

计算机视觉与模式识别 · 计算机科学 2020-03-09 Changlin Li , Jiefeng Peng , Liuchun Yuan , Guangrun Wang , Xiaodan Liang , Liang Lin , Xiaojun Chang

The efficient, automated search for well-performing neural architectures (NAS) has drawn increasing attention in the recent past. Thereby, the predominant research objective is to reduce the necessity of costly evaluations of neural…

机器学习 · 计算机科学 2022-08-02 Jovita Lukasik , Steffen Jung , Margret Keuper

Neural Architecture Search (NAS) has shown excellent results in designing architectures for computer vision problems. NAS alleviates the need for human-defined settings by automating architecture design and engineering. However, NAS methods…

机器学习 · 计算机科学 2021-10-29 Vasco Lopes , Saeid Alirezazadeh , Luís A. Alexandre

This paper offers a new perspective on Artificial Neural Networks (ANNs) architecture. Traditional ANNs commonly use tree-like or DAG structures for simplicity, which can be preset or determined by Neural Architecture Search (NAS). Yet,…

机器学习 · 计算机科学 2025-06-05 Xinshun Liu , Yizhi Fang , Yichao Jiang

Neural Architecture Search (NAS) that aims to automate the procedure of architecture design has achieved promising results in many computer vision fields. In this paper, we propose an AdversarialNAS method specially tailored for Generative…

计算机视觉与模式识别 · 计算机科学 2020-04-09 Chen Gao , Yunpeng Chen , Si Liu , Zhenxiong Tan , Shuicheng Yan

Finding a well-performing architecture is often tedious for both DL practitioners and researchers, leading to tremendous interest in the automation of this task by means of neural architecture search (NAS). Although the community has made…

机器学习 · 计算机科学 2020-11-04 Marius Lindauer , Frank Hutter

Neural Architecture Search (NAS) has been used recently to achieve improved performance in various tasks and most prominently in image classification. Yet, current search strategies rely on large labeled datasets, which limit their usage in…

机器学习 · 计算机科学 2020-07-06 Sapir Kaplan , Raja Giryes

While existing work on neural architecture search (NAS) tunes hyperparameters in a separate post-processing step, we demonstrate that architectural choices and other hyperparameter settings interact in a way that can render this separation…

机器学习 · 计算机科学 2018-07-19 Arber Zela , Aaron Klein , Stefan Falkner , Frank Hutter

Neural architecture search (NAS) has been an active direction of automatic machine learning (Auto-ML), aiming to explore efficient network structures. The searched architecture is evaluated by training on datasets with fixed data…

机器学习 · 计算机科学 2022-01-31 Xiaoxing Wang , Xiangxiang Chu , Junchi Yan , Xiaokang Yang

Differentiable Architecture Search (DARTS) has received massive attention in recent years, mainly because it significantly reduces the computational cost through weight sharing and continuous relaxation. However, more recent works find that…

机器学习 · 计算机科学 2021-11-29 Miao Zhang , Jilin Hu , Steven Su , Shirui Pan , Xiaojun Chang , Bin Yang , Gholamreza Haffari

Edge computing aims to enable edge devices, such as IoT devices, to process data locally instead of relying on the cloud. However, deep learning techniques like computer vision and natural language processing can be computationally…

计算机视觉与模式识别 · 计算机科学 2023-07-11 Oshin Dutta , Tanu Kanvar , Sumeet Agarwal

We present an elegant framework of fine-grained neural architecture search (FGNAS), which allows to employ multiple heterogeneous operations within a single layer and can even generate compositional feature maps using several different base…

计算机视觉与模式识别 · 计算机科学 2019-11-19 Heewon Kim , Seokil Hong , Bohyung Han , Heesoo Myeong , Kyoung Mu Lee

Neural Architecture Search (NAS) has emerged as a promising technique for automatic neural network design. However, existing MCTS based NAS approaches often utilize manually designed action space, which is not directly related to the…

机器学习 · 计算机科学 2021-04-02 Linnan Wang , Saining Xie , Teng Li , Rodrigo Fonseca , Yuandong Tian

Neural Architecture Search (NAS) has shown promising capability in learning text representation. However, existing text-based NAS neither performs a learnable fusion of neural operations to optimize the architecture, nor encodes the latent…

计算与语言 · 计算机科学 2023-07-13 Kuan-Chun Chen , Cheng-Te Li , Kuo-Jung Lee

This paper addresses the efficiency challenge of Neural Architecture Search (NAS) by formulating the task as a ranking problem. Previous methods require numerous training examples to estimate the accurate performance of architectures,…

计算与语言 · 计算机科学 2021-09-20 Chi Hu , Chenglong Wang , Xiangnan Ma , Xia Meng , Yinqiao Li , Tong Xiao , Jingbo Zhu , Changliang Li

Due to their high computational efficiency on a continuous space, gradient optimization methods have shown great potential in the neural architecture search (NAS) domain. The mapping of network representation from the discrete space to a…

机器学习 · 计算机科学 2020-06-20 Jian Li , Yong Liu , Jiankun Liu , Weiping Wang

Neural Architecture Search (NAS) is an automated technique to design optimal neural network architectures for a specific workload. Conventionally, evaluating candidate networks in NAS involves extensive training, which requires significant…

机器学习 · 计算机科学 2025-06-05 Tomomasa Yamasaki , Zhehui Wang , Tao Luo , Niangjun Chen , Bo Wang

Neural network-based semantic segmentation has achieved remarkable results when large amounts of annotated data are available, that is, in the supervised case. However, such data is expensive to collect and so methods have been developed to…

计算机视觉与模式识别 · 计算机科学 2021-06-25 Xueqing Deng , Yi Zhu , Yuxin Tian , Shawn Newsam