中文
相关论文

相关论文: IS-DARTS: Stabilizing DARTS through Precise Measur…

200 篇论文

Neural architecture search (NAS) recently attracts much research attention because of its ability to identify better architectures than handcrafted ones. However, many NAS methods, which optimize the search process in a discrete search…

机器学习 · 计算机科学 2019-11-22 Quanming Yao , Ju Xu , Wei-Wei Tu , Zhanxing Zhu

Recently, there has been a growing interest in automating the process of neural architecture design, and the Differentiable Architecture Search (DARTS) method makes the process available within a few GPU days. However, the performance of…

计算机视觉与模式识别 · 计算机科学 2020-10-21 Hanwen Liang , Shifeng Zhang , Jiacheng Sun , Xingqiu He , Weiran Huang , Kechen Zhuang , Zhenguo Li

Differentiable Neural Architecture Search is one of the most popular Neural Architecture Search (NAS) methods for its search efficiency and simplicity, accomplished by jointly optimizing the model weight and architecture parameters in a…

机器学习 · 计算机科学 2021-08-11 Ruochen Wang , Minhao Cheng , Xiangning Chen , Xiaocheng Tang , Cho-Jui Hsieh

Improving the efficiency of Neural Architecture Search (NAS) is a challenging but significant task that has received much attention. Previous works mainly adopted the Differentiable Architecture Search (DARTS) and improved its search…

计算机视觉与模式识别 · 计算机科学 2023-12-25 Chongjun Tu , Peng Ye , Weihao Lin , Hancheng Ye , Chong Yu , Tao Chen , Baopu Li , Wanli Ouyang

Differentiable Architecture Search (DARTS) is a recent neural architecture search (NAS) method based on a differentiable relaxation. Due to its success, numerous variants analyzing and improving parts of the DARTS framework have recently…

机器学习 · 计算机科学 2021-10-19 Kaitlin Maile , Erwan Lecarpentier , Hervé Luga , Dennis G. Wilson

Neural Architecture Search (NAS) has gained attraction due to superior classification performance. Differential Architecture Search (DARTS) is a computationally light method. To limit computational resources DARTS makes numerous…

计算机视觉与模式识别 · 计算机科学 2020-11-17 Muhammad Suhaib Tanveer , Muhammad Umar Karim Khan , Chong-Min Kyung

Differentiable architecture search (DARTS) yields highly efficient gradient-based neural architecture search (NAS) by relaxing the discrete operation selection to optimize continuous architecture parameters that maps NAS from the discrete…

机器学习 · 计算机科学 2023-06-13 Jiuling Zhang , Zhiming Ding

Neural architecture search (NAS) has gained significant traction in automating the design of neural networks. To reduce search time, differentiable architecture search (DAS) reframes the traditional paradigm of discrete candidate sampling…

机器学习 · 计算机科学 2025-11-26 Xiaoyun Liu , Divya Saxena , Jiannong Cao , Yuqing Zhao , Penghui Ruan

Differentiable Architecture Search (DARTS) is a simple yet efficient Neural Architecture Search (NAS) method. During the search stage, DARTS trains a supernet by jointly optimizing architecture parameters and network parameters. During the…

计算机视觉与模式识别 · 计算机科学 2023-09-04 Xunyu Zhu , Jian Li , Yong Liu , Weiping Wang

Differentiable architecture search (DARTS) provided a fast solution in finding effective network architectures, but suffered from large memory and computing overheads in jointly training a super-network and searching for an optimal…

计算机视觉与模式识别 · 计算机科学 2020-04-08 Yuhui Xu , Lingxi Xie , Xiaopeng Zhang , Xin Chen , Guo-Jun Qi , Qi Tian , Hongkai Xiong

Eye movement biometrics is a secure and innovative identification method. Deep learning methods have shown good performance, but their network architecture relies on manual design and combined priori knowledge. To address these issues, we…

计算机视觉与模式识别 · 计算机科学 2024-09-19 Hongyu Zhu , Xin Jin , Hongchao Liao , Yan Xiang , Mounim A. El-Yacoubi , Huafeng Qin

With the rapid development of neural architecture search (NAS), researchers found powerful network architectures for a wide range of vision tasks. However, it remains unclear if the searched architecture can transfer across different types…

计算机视觉与模式识别 · 计算机科学 2020-01-07 Xin Chen , Lingxi Xie , Jun Wu , Qi Tian

Differentiable Architecture Search (DARTS) is an efficient Neural Architecture Search (NAS) method but suffers from robustness, generalization, and discrepancy issues. Many efforts have been made towards the performance collapse issue…

神经与进化计算 · 计算机科学 2025-04-24 Yanlin Zhou , Mostafa El-Khamy , Kee-Bong Song

DARTS search space (DSS) has become a canonical benchmark for NAS whereas some emerging works pointed out the issue of narrow accuracy range and claimed it would hurt the method ranking. We observe some recent studies already suffer from…

机器学习 · 计算机科学 2023-06-13 Jiuling Zhang , Zhiming Ding

Differentiable Architecture Search (DARTS) has received massive attention in recent years, mainly because it significantly reduces the computational cost through weight sharing and continuous relaxation. However, more recent works find that…

机器学习 · 计算机科学 2021-11-29 Miao Zhang , Jilin Hu , Steven Su , Shirui Pan , Xiaojun Chang , Bin Yang , Gholamreza Haffari

Recent neural architecture search (NAS) works proposed training-free metrics to rank networks which largely reduced the search cost in NAS. In this paper, we revisit these training-free metrics and find that: (1) the number of parameters…

计算机视觉与模式识别 · 计算机科学 2022-11-17 Taojiannan Yang , Linjie Yang , Xiaojie Jin , Chen Chen

Neural architecture search (NAS) aims to produce the optimal sparse solution from a high-dimensional space spanned by all candidate connections. Current gradient-based NAS methods commonly ignore the constraint of sparsity in the search…

计算机视觉与模式识别 · 计算机科学 2020-10-14 Yibo Yang , Hongyang Li , Shan You , Fei Wang , Chen Qian , Zhouchen Lin

While recent NAS algorithms are thousands of times faster than the pioneering works, it is often overlooked that they use fewer candidate operations, resulting in a significantly smaller search space. We present PR-DARTS, a NAS algorithm…

机器学习 · 计算机科学 2021-04-23 Kevin Alexander Laube , Andreas Zell

Recently, the efficiency of automatic neural architecture design has been significantly improved by gradient-based search methods such as DARTS. However, recent literature has brought doubt to the generalization ability of DARTS, arguing…

机器学习 · 计算机科学 2021-01-26 Guilin Li , Xing Zhang , Zitong Wang , Matthias Tan , Jiashi Feng , Zhenguo Li , Tong Zhang

In this paper, we point out that differential architecture search (DARTS) makes gradient of architecture parameters biased for network weights and architecture parameters are updated in different datasets alternatively in the bi-level…

机器学习 · 计算机科学 2020-12-22 Pengfei Hou , Ying Jin