中文
相关论文

相关论文: Warm-starting DARTS using meta-learning

200 篇论文

The rapid proliferation of computing domains relying on Internet of Things (IoT) devices has created a pressing need for efficient and accurate deep-learning (DL) models that can run on low-power devices. However, traditional DL models tend…

We present a Model Uncertainty-aware Differentiable ARchiTecture Search ($\mu$DARTS) that optimizes neural networks to simultaneously achieve high accuracy and low uncertainty. We introduce concrete dropout within DARTS cells and include a…

机器学习 · 计算机科学 2022-09-13 Biswadeep Chakraborty , Saibal Mukhopadhyay

Neural Architecture Search (NAS) is a powerful tool for automating architecture design. One-Shot NAS techniques, such as DARTS, have gained substantial popularity due to their combination of search efficiency with simplicity of…

机器学习 · 计算机科学 2025-05-21 Pavel Rumiantsev , Mark Coates

Neural Architecture Search (NAS) has been widely studied for designing discriminative deep learning models such as image classification, object detection, and semantic segmentation. As a large number of priors have been obtained through the…

计算机视觉与模式识别 · 计算机科学 2019-06-07 Jie An , Haoyi Xiong , Jinwen Ma , Jiebo Luo , Jun Huan

Neural Architecture Search (NAS) aims to facilitate the design of deep networks for new tasks. Existing techniques rely on two stages: searching over the architecture space and validating the best architecture. NAS algorithms are currently…

机器学习 · 计算机科学 2019-11-25 Kaicheng Yu , Christian Sciuto , Martin Jaggi , Claudiu Musat , Mathieu Salzmann

Deep neural networks have brought significant advancements to speech emotion recognition (SER). However, the architecture design in SER is mainly based on expert knowledge and empirical (trial-and-error) evaluations, which is time-consuming…

声音 · 计算机科学 2022-04-01 Xixin Wu , Shoukang Hu , Zhiyong Wu , Xunying Liu , Helen Meng

Neural architecture search (NAS), the study of automating the discovery of optimal deep neural network architectures for tasks in domains such as computer vision and natural language processing, has seen rapid growth in the machine learning…

神经与进化计算 · 计算机科学 2022-03-01 Daniel Cummings , Sharath Nittur Sridhar , Anthony Sarah , Maciej Szankin

Neural architecture search (NAS) relies on a good controller to generate better architectures or predict the accuracy of given architectures. However, training the controller requires both abundant and high-quality pairs of architectures…

机器学习 · 计算机科学 2020-11-04 Renqian Luo , Xu Tan , Rui Wang , Tao Qin , Enhong Chen , Tie-Yan Liu

Neural architecture search (NAS) has advanced significantly in recent years but most NAS systems restrict search to learning architectures of a recurrent or convolutional cell. In this paper, we extend the search space of NAS. In…

机器学习 · 计算机科学 2020-06-08 Yinqiao Li , Chi Hu , Yuhao Zhang , Nuo Xu , Yufan Jiang , Tong Xiao , Jingbo Zhu , Tongran Liu , Changliang Li

Neural architecture search (NAS) has allowed for the automatic creation of new and effective neural network architectures, offering an alternative to the laborious process of manually designing complex architectures. However, traditional…

机器学习 · 计算机科学 2023-06-02 Aaron Serianni , Jugal Kalita

Neural Architecture Search (NAS) has emerged as a key tool in identifying optimal configurations of deep neural networks tailored to specific tasks. However, training and assessing numerous architectures introduces considerable…

机器学习 · 计算机科学 2024-04-25 Haoming Zhang , Ran Cheng

Neural architecture search (NAS) has shown great promise in automatically designing lightweight models. However, conventional approaches are insufficient in training the supernet and pay little attention to actual robot hardware resources.…

机器人学 · 计算机科学 2025-09-26 Shouren Mao , Minghao Qin , Wei Dong , Huajian Liu , Yongzhuo Gao

Neural Architecture Search (NAS) is increasingly popular to automatically explore the accuracy versus computational complexity trade-off of Deep Learning (DL) architectures. When targeting tiny edge devices, the main challenge for DL…

机器学习 · 计算机科学 2023-01-26 Matteo Risso , Alessio Burrello , Luca Benini , Enrico Macii , Massimo Poncino , Daniele Jahier Pagliari

Convolutional neural networks (CNNs) have shown good performance in polarimetric synthetic aperture radar (PolSAR) image classification due to the automation of feature engineering. Excellent hand-crafted architectures of CNNs incorporated…

计算机视觉与模式识别 · 计算机科学 2020-12-16 Hongwei Dong , Siyu Zhang , Bin Zou , Lamei Zhang

The time and effort involved in hand-designing deep neural networks is immense. This has prompted the development of Neural Architecture Search (NAS) techniques to automate this design. However, NAS algorithms tend to be slow and expensive;…

机器学习 · 计算机科学 2021-06-14 Joseph Mellor , Jack Turner , Amos Storkey , Elliot J. Crowley

Neural Architecture Search (NAS) aims to automate the discovery of high-performing deep neural network architectures. Traditional objective-based NAS approaches typically optimize a certain performance metric (e.g., prediction accuracy),…

神经与进化计算 · 计算机科学 2024-08-01 An Vo , Ngoc Hoang Luong

Differentiable ARchiTecture Search (DARTS) uses a continuous relaxation of network representation and dramatically accelerates Neural Architecture Search (NAS) by almost thousands of times in GPU-day. However, the searching process of DARTS…

计算机视觉与模式识别 · 计算机科学 2021-08-26 Huiqun Wang , Ruijie Yang , Di Huang , Yunhong Wang

Continual learning with neural networks is an important learning framework in AI that aims to learn a sequence of tasks well. However, it is often confronted with three challenges: (1) overcome the catastrophic forgetting problem, (2) adapt…

机器学习 · 计算机科学 2020-06-11 Qiang Gao , Zhipeng Luo , Diego Klabjan

Weight sharing, as an approach to speed up architecture performance estimation has received wide attention. Instead of training each architecture separately, weight sharing builds a supernet that assembles all the architectures as its…

机器学习 · 计算机科学 2021-05-06 Yuge Zhang , Quanlu Zhang , Yaming Yang

The search space of neural architecture search (NAS) for convolutional neural network (CNN) is huge. To reduce searching cost, most NAS algorithms use fixed outer network level structure, and search the repeatable cell structure only. Such…

计算机视觉与模式识别 · 计算机科学 2020-08-14 Chunnan Wang , Hongzhi Wang , Guosheng Feng , Fei Geng