中文
相关论文

相关论文: Fair DARTS: Eliminating Unfair Advantages in Diffe…

200 篇论文

Simplicity is the ultimate sophistication. Differentiable Architecture Search (DARTS) has now become one of the mainstream paradigms of neural architecture search. However, it largely suffers from the well-known performance collapse issue…

机器学习 · 计算机科学 2021-10-19 Xiangxiang Chu , Bo Zhang

Differentiable architecture search (DARTS) marks a milestone in Neural Architecture Search (NAS), boasting simplicity and small search costs. However, DARTS still suffers from frequent performance collapse, which happens when some…

计算机视觉与模式识别 · 计算机科学 2021-08-19 Pengfei Hou , Ying Jin , Yukang Chen

Recently, there has been a growing interest in automating the process of neural architecture design, and the Differentiable Architecture Search (DARTS) method makes the process available within a few GPU days. However, the performance of…

计算机视觉与模式识别 · 计算机科学 2020-10-21 Hanwen Liang , Shifeng Zhang , Jiacheng Sun , Xingqiu He , Weiran Huang , Kechen Zhuang , Zhenguo Li

Differentiable ARchiTecture Search (DARTS) is one of the most trending Neural Architecture Search (NAS) methods. It drastically reduces search cost by resorting to weight-sharing. However, it also dramatically reduces the search space, thus…

机器学习 · 计算机科学 2022-11-02 Alexandre Heuillet , Hedi Tabia , Hichem Arioui , Kamal Youcef-Toumi

Neural architecture search (NAS) is a recent methodology for automating the design of neural network architectures. Differentiable neural architecture search (DARTS) is a promising NAS approach that dramatically increases search efficiency.…

机器学习 · 计算机科学 2021-04-22 Erik Bodin , Federico Tomasi , Zhenwen Dai

Differentiable neural architecture search (DARTS) is a popular method for neural architecture search (NAS), which performs cell-search and utilizes continuous relaxation to improve the search efficiency via gradient-based optimization. The…

Differentiable Neural Architecture Search (DARTS) is becoming more and more popular among Neural Architecture Search (NAS) methods because of its high search efficiency and low compute cost. However, the stability of DARTS is very inferior,…

计算机视觉与模式识别 · 计算机科学 2023-02-14 Xunyu Zhu , Jian Li , Yong Liu , Weiping Wang

Differentiable architecture search (DARTS) is an effective method for data-driven neural network design based on solving a bilevel optimization problem. Despite its success in many architecture search tasks, there are still some concerns…

机器学习 · 计算机科学 2022-06-27 Fanghui Xue , Yingyong Qi , Jack Xin

Differentiable architecture search (DARTS) has significantly promoted the development of NAS techniques because of its high search efficiency and effectiveness but suffers from performance collapse. In this paper, we make efforts to…

计算机视觉与模式识别 · 计算机科学 2022-08-19 Xuanyang Zhang , Yonggang Li , Xiangyu Zhang , Yongtao Wang , Jian Sun

Despite the fast development of differentiable architecture search (DARTS), it suffers from long-standing performance instability, which extremely limits its application. Existing robustifying methods draw clues from the resulting…

机器学习 · 计算机科学 2021-01-18 Xiangxiang Chu , Xiaoxing Wang , Bo Zhang , Shun Lu , Xiaolin Wei , Junchi Yan

Differentiable Architecture Search (DARTS) has received massive attention in recent years, mainly because it significantly reduces the computational cost through weight sharing and continuous relaxation. However, more recent works find that…

机器学习 · 计算机科学 2021-11-29 Miao Zhang , Jilin Hu , Steven Su , Shirui Pan , Xiaojun Chang , Bin Yang , Gholamreza Haffari

Differentiable Architecture Search (DARTS) is an efficient Neural Architecture Search (NAS) method but suffers from robustness, generalization, and discrepancy issues. Many efforts have been made towards the performance collapse issue…

神经与进化计算 · 计算机科学 2025-04-24 Yanlin Zhou , Mostafa El-Khamy , Kee-Bong Song

Neural Architecture Search (NAS) has been a source of dramatic improvements in neural network design, with recent results meeting or exceeding the performance of hand-tuned architectures. However, our understanding of how to represent the…

计算机视觉与模式识别 · 计算机科学 2019-03-26 Andrew Hundt , Varun Jain , Gregory D. Hager

Differentiable Architecture Search (DARTS) is an effective continuous relaxation-based network architecture search (NAS) method with low search cost. It has attracted significant attentions in Auto-ML research and becomes one of the most…

人工智能 · 计算机科学 2022-03-10 Jun-Wei Hsieh , Ming-Ching Chang , Ping-Yang Chen , Santanu Santra , Cheng-Han Chou , Chih-Sheng Huang

This paper addresses the scalability challenge of architecture search by formulating the task in a differentiable manner. Unlike conventional approaches of applying evolution or reinforcement learning over a discrete and non-differentiable…

机器学习 · 计算机科学 2019-04-24 Hanxiao Liu , Karen Simonyan , Yiming Yang

Differentiable Architecture Search (DARTS) is a recent neural architecture search (NAS) method based on a differentiable relaxation. Due to its success, numerous variants analyzing and improving parts of the DARTS framework have recently…

机器学习 · 计算机科学 2021-10-19 Kaitlin Maile , Erwan Lecarpentier , Hervé Luga , Dennis G. Wilson

Differentiable architecture search (DARTS) is widely considered to be easy to overfit the validation set which leads to performance degradation. We first employ a series of exploratory experiments to verify that neither high-strength…

机器学习 · 计算机科学 2021-09-29 Jiuling Zhang , Zhiming Ding

Differentiable Architecture Search (DARTS) has attracted a lot of attention due to its simplicity and small search costs achieved by a continuous relaxation and an approximation of the resulting bi-level optimization problem. However, DARTS…

机器学习 · 计算机科学 2020-01-29 Arber Zela , Thomas Elsken , Tonmoy Saikia , Yassine Marrakchi , Thomas Brox , Frank Hutter

Differentiable architecture search (DARTS) has been a mainstream direction in automatic machine learning. Since the discovery that original DARTS will inevitably converge to poor architectures, recent works alleviate this by either…

计算机视觉与模式识别 · 计算机科学 2022-11-21 Bicheng Guo , Shuxuan Guo , Miaojing Shi , Peng Chen , Shibo He , Jiming Chen , Kaicheng Yu

Differentiable neural architecture search (DARTS), as a gradient-guided search method, greatly reduces the cost of computation and speeds up the search. In DARTS, the architecture parameters are introduced to the candidate operations, but…

机器学习 · 计算机科学 2022-08-02 Yu Xue , Jiafeng Qin
‹ 上一页 1 2 3 10 下一页 ›