English
Related papers

Related papers: sharpDARTS: Faster and More Accurate Differentiabl…

200 papers

Differentiable architecture search (DARTS) has significantly promoted the development of NAS techniques because of its high search efficiency and effectiveness but suffers from performance collapse. In this paper, we make efforts to…

Computer Vision and Pattern Recognition · Computer Science 2022-08-19 Xuanyang Zhang , Yonggang Li , Xiangyu Zhang , Yongtao Wang , Jian Sun

Neural Architecture Search (NAS) has gained attraction due to superior classification performance. Differential Architecture Search (DARTS) is a computationally light method. To limit computational resources DARTS makes numerous…

Computer Vision and Pattern Recognition · Computer Science 2020-11-17 Muhammad Suhaib Tanveer , Muhammad Umar Karim Khan , Chong-Min Kyung

Differentiable architecture search (DARTS) is an effective method for data-driven neural network design based on solving a bilevel optimization problem. Despite its success in many architecture search tasks, there are still some concerns…

Machine Learning · Computer Science 2022-06-27 Fanghui Xue , Yingyong Qi , Jack Xin

Neural architecture search (NAS) is a recent methodology for automating the design of neural network architectures. Differentiable neural architecture search (DARTS) is a promising NAS approach that dramatically increases search efficiency.…

Machine Learning · Computer Science 2021-04-22 Erik Bodin , Federico Tomasi , Zhenwen Dai

Neural architecture search (NAS) has gained significant traction in automating the design of neural networks. To reduce search time, differentiable architecture search (DAS) reframes the traditional paradigm of discrete candidate sampling…

Machine Learning · Computer Science 2025-11-26 Xiaoyun Liu , Divya Saxena , Jiannong Cao , Yuqing Zhao , Penghui Ruan

DARTS is a popular algorithm for neural architecture search (NAS). Despite its great advantage in search efficiency, DARTS often suffers weak stability, which reflects in the large variation among individual trials as well as the…

Machine Learning · Computer Science 2020-05-05 Kaifeng Bi , Changping Hu , Lingxi Xie , Xin Chen , Longhui Wei , Qi Tian

Differentiable ARchiTecture Search, i.e., DARTS, has drawn great attention in neural architecture search. It tries to find the optimal architecture in a shallow search network and then measures its performance in a deep evaluation network.…

Computer Vision and Pattern Recognition · Computer Science 2022-04-26 Hongyuan Yu , Houwen Peng , Yan Huang , Jianlong Fu , Hao Du , Liang Wang , Haibin Ling

With the rapid development of neural architecture search (NAS), researchers found powerful network architectures for a wide range of vision tasks. However, it remains unclear if the searched architecture can transfer across different types…

Computer Vision and Pattern Recognition · Computer Science 2020-01-07 Xin Chen , Lingxi Xie , Jun Wu , Qi Tian

Differentiable ARchiTecture Search (DARTS) is one of the most trending Neural Architecture Search (NAS) methods. It drastically reduces search cost by resorting to weight-sharing. However, it also dramatically reduces the search space, thus…

Machine Learning · Computer Science 2022-11-02 Alexandre Heuillet , Hedi Tabia , Hichem Arioui , Kamal Youcef-Toumi

\textit{Differentiable ARchiTecture Search} (DARTS) has recently become the mainstream of neural architecture search (NAS) due to its efficiency and simplicity. With a gradient-based bi-level optimization, DARTS alternately optimizes the…

Machine Learning · Computer Science 2021-06-22 Miao Zhang , Steven Su , Shirui Pan , Xiaojun Chang , Ehsan Abbasnejad , Reza Haffari

Differentiable architecture search (DARTS) has been a popular one-shot paradigm for NAS due to its high efficiency. It introduces trainable architecture parameters to represent the importance of candidate operations and proposes…

Computer Vision and Pattern Recognition · Computer Science 2022-02-01 Xiaoxing Wang , Wenxuan Guo , Junchi Yan , Jianlin Su , Xiaokang Yang

Neural architecture search (NAS) recently attracts much research attention because of its ability to identify better architectures than handcrafted ones. However, many NAS methods, which optimize the search process in a discrete search…

Machine Learning · Computer Science 2019-11-22 Quanming Yao , Ju Xu , Wei-Wei Tu , Zhanxing Zhu

Differentiable Architecture Search (DARTS) is a simple yet efficient Neural Architecture Search (NAS) method. During the search stage, DARTS trains a supernet by jointly optimizing architecture parameters and network parameters. During the…

Computer Vision and Pattern Recognition · Computer Science 2023-09-04 Xunyu Zhu , Jian Li , Yong Liu , Weiping Wang

Differentiable ARchiTecture Search (DARTS) uses a continuous relaxation of network representation and dramatically accelerates Neural Architecture Search (NAS) by almost thousands of times in GPU-day. However, the searching process of DARTS…

Computer Vision and Pattern Recognition · Computer Science 2021-08-26 Huiqun Wang , Ruijie Yang , Di Huang , Yunhong Wang

Spiking Neural Networks (SNNs) have gained enormous popularity in the field of artificial intelligence due to their low power consumption. However, the majority of SNN methods directly inherit the structure of Artificial Neural Networks…

Neural and Evolutionary Computing · Computer Science 2024-11-05 Yilei Man , Linhai Xie , Shushan Qiao , Yumei Zhou , Delong Shang

Differentiable Architecture Search (DARTS) has received massive attention in recent years, mainly because it significantly reduces the computational cost through weight sharing and continuous relaxation. However, more recent works find that…

Machine Learning · Computer Science 2021-11-29 Miao Zhang , Jilin Hu , Steven Su , Shirui Pan , Xiaojun Chang , Bin Yang , Gholamreza Haffari

Differentiable Architecture Search (DARTS) is an effective continuous relaxation-based network architecture search (NAS) method with low search cost. It has attracted significant attentions in Auto-ML research and becomes one of the most…

Artificial Intelligence · Computer Science 2022-03-10 Jun-Wei Hsieh , Ming-Ching Chang , Ping-Yang Chen , Santanu Santra , Cheng-Han Chou , Chih-Sheng Huang

Differentiable Architecture Search (DARTS) has attracted a lot of attention due to its simplicity and small search costs achieved by a continuous relaxation and an approximation of the resulting bi-level optimization problem. However, DARTS…

Machine Learning · Computer Science 2020-01-29 Arber Zela , Thomas Elsken , Tonmoy Saikia , Yassine Marrakchi , Thomas Brox , Frank Hutter

In this paper, we investigate the fundamental question: To what extent are gradient-based neural architecture search (NAS) techniques applicable to RL? Using the original DARTS as a convenient baseline, we discover that the discrete…

Machine Learning · Computer Science 2022-11-16 Yingjie Miao , Xingyou Song , John D. Co-Reyes , Daiyi Peng , Summer Yue , Eugene Brevdo , Aleksandra Faust

Differentiable architecture search (DARTS) has been a mainstream direction in automatic machine learning. Since the discovery that original DARTS will inevitably converge to poor architectures, recent works alleviate this by either…

Computer Vision and Pattern Recognition · Computer Science 2022-11-21 Bicheng Guo , Shuxuan Guo , Miaojing Shi , Peng Chen , Shibo He , Jiming Chen , Kaicheng Yu
‹ Prev 1 2 3 10 Next ›