English
Related papers

Related papers: Understanding and Robustifying Differentiable Arch…

200 papers

Differentiable architecture search (DARTS) is a prevailing NAS solution to identify architectures. Based on the continuous relaxation of the architecture space, DARTS learns a differentiable architecture weight and largely reduces the…

Machine Learning · Computer Science 2021-01-19 Xiangning Chen , Cho-Jui Hsieh

Differentiable architecture search (DARTS) is widely considered to be easy to overfit the validation set which leads to performance degradation. We first employ a series of exploratory experiments to verify that neither high-strength…

Machine Learning · Computer Science 2021-09-29 Jiuling Zhang , Zhiming Ding

Differentiable architecture search (DARTS) marks a milestone in Neural Architecture Search (NAS), boasting simplicity and small search costs. However, DARTS still suffers from frequent performance collapse, which happens when some…

Computer Vision and Pattern Recognition · Computer Science 2021-08-19 Pengfei Hou , Ying Jin , Yukang Chen

Neural architecture search (NAS) is a recent methodology for automating the design of neural network architectures. Differentiable neural architecture search (DARTS) is a promising NAS approach that dramatically increases search efficiency.…

Machine Learning · Computer Science 2021-04-22 Erik Bodin , Federico Tomasi , Zhenwen Dai

Neural Architecture Search (NAS) has been a source of dramatic improvements in neural network design, with recent results meeting or exceeding the performance of hand-tuned architectures. However, our understanding of how to represent the…

Computer Vision and Pattern Recognition · Computer Science 2019-03-26 Andrew Hundt , Varun Jain , Gregory D. Hager

Differentiable Architecture Search (DARTS) is a recent neural architecture search (NAS) method based on a differentiable relaxation. Due to its success, numerous variants analyzing and improving parts of the DARTS framework have recently…

Machine Learning · Computer Science 2021-10-19 Kaitlin Maile , Erwan Lecarpentier , Hervé Luga , Dennis G. Wilson

Differentiable ARchiTecture Search (DARTS) uses a continuous relaxation of network representation and dramatically accelerates Neural Architecture Search (NAS) by almost thousands of times in GPU-day. However, the searching process of DARTS…

Computer Vision and Pattern Recognition · Computer Science 2021-08-26 Huiqun Wang , Ruijie Yang , Di Huang , Yunhong Wang

We present a Model Uncertainty-aware Differentiable ARchiTecture Search ($\mu$DARTS) that optimizes neural networks to simultaneously achieve high accuracy and low uncertainty. We introduce concrete dropout within DARTS cells and include a…

Machine Learning · Computer Science 2022-09-13 Biswadeep Chakraborty , Saibal Mukhopadhyay

Differentiable neural architecture search (DARTS) is a popular method for neural architecture search (NAS), which performs cell-search and utilizes continuous relaxation to improve the search efficiency via gradient-based optimization. The…

Differentiable Architecture Search (DARTS) is an effective continuous relaxation-based network architecture search (NAS) method with low search cost. It has attracted significant attentions in Auto-ML research and becomes one of the most…

Artificial Intelligence · Computer Science 2022-03-10 Jun-Wei Hsieh , Ming-Ching Chang , Ping-Yang Chen , Santanu Santra , Cheng-Han Chou , Chih-Sheng Huang

Differentiable architecture search (DARTS) is a promising end to end NAS method which directly optimizes the architecture parameters through general gradient descent. However, DARTS is brittle to the catastrophic failure incurred by the…

Machine Learning · Computer Science 2023-06-13 Jiuling Zhang , Zhiming Ding

Differentiable architecture search (DARTS) is an effective method for data-driven neural network design based on solving a bilevel optimization problem. Despite its success in many architecture search tasks, there are still some concerns…

Machine Learning · Computer Science 2022-06-27 Fanghui Xue , Yingyong Qi , Jack Xin

This paper addresses the scalability challenge of architecture search by formulating the task in a differentiable manner. Unlike conventional approaches of applying evolution or reinforcement learning over a discrete and non-differentiable…

Machine Learning · Computer Science 2019-04-24 Hanxiao Liu , Karen Simonyan , Yiming Yang

DARTS is a popular algorithm for neural architecture search (NAS). Despite its great advantage in search efficiency, DARTS often suffers weak stability, which reflects in the large variation among individual trials as well as the…

Machine Learning · Computer Science 2020-05-05 Kaifeng Bi , Changping Hu , Lingxi Xie , Xin Chen , Longhui Wei , Qi Tian

Differentiable architecture search (DARTS) has been a mainstream direction in automatic machine learning. Since the discovery that original DARTS will inevitably converge to poor architectures, recent works alleviate this by either…

Computer Vision and Pattern Recognition · Computer Science 2022-11-21 Bicheng Guo , Shuxuan Guo , Miaojing Shi , Peng Chen , Shibo He , Jiming Chen , Kaicheng Yu

Differentiable architecture search (DARTS) has emerged as a promising technique for effective neural architecture search, and it mainly contains two steps to find the high-performance architecture: First, the DARTS supernet that consists of…

Artificial Intelligence · Computer Science 2024-09-24 Le Yang , Ziwei Zheng , Yizeng Han , Shiji Song , Gao Huang , Fan Li

Differentiable ARchiTecture Search (DARTS) is one of the most trending Neural Architecture Search (NAS) methods. It drastically reduces search cost by resorting to weight-sharing. However, it also dramatically reduces the search space, thus…

Machine Learning · Computer Science 2022-11-02 Alexandre Heuillet , Hedi Tabia , Hichem Arioui , Kamal Youcef-Toumi

Neural Architecture Search has attracted increasing attention in recent years. Among them, differential NAS approaches such as DARTS, have gained popularity for the search efficiency. However, they still suffer from three main issues, that…

Machine Learning · Computer Science 2023-01-18 Peng Ye , Tong He , Baopu Li , Tao Chen , Lei Bai , Wanli Ouyang

Neural Architecture Search~(NAS) has attracted increasingly more attention in recent years because of its capability to design deep neural networks automatically. Among them, differential NAS approaches such as DARTS, have gained popularity…

Machine Learning · Computer Science 2022-03-07 Peng Ye , Baopu Li , Yikang Li , Tao Chen , Jiayuan Fan , Wanli Ouyang

Neural architecture search (NAS) has gained significant traction in automating the design of neural networks. To reduce search time, differentiable architecture search (DAS) reframes the traditional paradigm of discrete candidate sampling…

Machine Learning · Computer Science 2025-11-26 Xiaoyun Liu , Divya Saxena , Jiannong Cao , Yuqing Zhao , Penghui Ruan
‹ Prev 1 2 3 10 Next ›