English
Related papers

Related papers: Delve into the Performance Degradation of Differen…

200 papers

Differentiable ARchiTecture Search, i.e., DARTS, has drawn great attention in neural architecture search. It tries to find the optimal architecture in a shallow search network and then measures its performance in a deep evaluation network.…

Computer Vision and Pattern Recognition · Computer Science 2022-04-26 Hongyuan Yu , Houwen Peng , Yan Huang , Jianlong Fu , Hao Du , Liang Wang , Haibin Ling

Neural Architecture Search~(NAS) has attracted increasingly more attention in recent years because of its capability to design deep neural networks automatically. Among them, differential NAS approaches such as DARTS, have gained popularity…

Machine Learning · Computer Science 2022-03-07 Peng Ye , Baopu Li , Yikang Li , Tao Chen , Jiayuan Fan , Wanli Ouyang

We present a Model Uncertainty-aware Differentiable ARchiTecture Search ($\mu$DARTS) that optimizes neural networks to simultaneously achieve high accuracy and low uncertainty. We introduce concrete dropout within DARTS cells and include a…

Machine Learning · Computer Science 2022-09-13 Biswadeep Chakraborty , Saibal Mukhopadhyay

In this paper, we attempt to address the challenge of applying Neural Architecture Search (NAS) algorithms, specifically the Differentiable Architecture Search (DARTS), to long-tailed datasets where class distribution is highly imbalanced.…

Machine Learning · Computer Science 2024-06-12 Chenxia Tang

Neural architecture search (NAS) recently attracts much research attention because of its ability to identify better architectures than handcrafted ones. However, many NAS methods, which optimize the search process in a discrete search…

Machine Learning · Computer Science 2019-11-22 Quanming Yao , Ju Xu , Wei-Wei Tu , Zhanxing Zhu

This paper reports the first successful application of a differentiable architecture search (DARTS) approach to the deepfake and spoofing detection problems. An example of neural architecture search, DARTS operates upon a continuous,…

Machine Learning · Computer Science 2021-07-01 Wanying Ge , Michele Panariello , Jose Patino , Massimiliano Todisco , Nicholas Evans

Neural architecture search (NAS) has shown great promise in the field of automated machine learning (AutoML). NAS has outperformed hand-designed networks and made a significant step forward in the field of automating the design of deep…

Machine Learning · Computer Science 2022-05-16 Matej Grobelnik , Joaquin Vanschoren

Neural Architecture Search has attracted increasing attention in recent years. Among them, differential NAS approaches such as DARTS, have gained popularity for the search efficiency. However, they still suffer from three main issues, that…

Machine Learning · Computer Science 2023-01-18 Peng Ye , Tong He , Baopu Li , Tao Chen , Lei Bai , Wanli Ouyang

Neural Architecture Search (NAS) has gained attraction due to superior classification performance. Differential Architecture Search (DARTS) is a computationally light method. To limit computational resources DARTS makes numerous…

Computer Vision and Pattern Recognition · Computer Science 2020-11-17 Muhammad Suhaib Tanveer , Muhammad Umar Karim Khan , Chong-Min Kyung

This study aims at making the architecture search process more adaptive for one-shot or online training. It is extended from the existing study on differentiable neural architecture search, and we made the backbone architecture…

Artificial Intelligence · Computer Science 2021-06-15 Renlong Jie , Junbin Gao

Differentiable ARchiTecture Search (DARTS) is one of the most trending Neural Architecture Search (NAS) methods. It drastically reduces search cost by resorting to weight-sharing. However, it also dramatically reduces the search space, thus…

Machine Learning · Computer Science 2022-11-02 Alexandre Heuillet , Hedi Tabia , Hichem Arioui , Kamal Youcef-Toumi

AI technology has made remarkable achievements in computational pathology (CPath), especially with the help of deep neural networks. However, the network performance is highly related to architecture design, which commonly requires human…

Computer Vision and Pattern Recognition · Computer Science 2021-08-17 Sheyang Tang , Mahdi S. Hosseini , Lina Chen , Sonal Varma , Corwyn Rowsell , Savvas Damaskinos , Konstantinos N. Plataniotis , Zhou Wang

In differentiable neural architecture search (NAS) algorithms like DARTS, the training set used to update model weight and the validation set used to update model architectures are sampled from the same data distribution. Thus, the uncommon…

Machine Learning · Computer Science 2021-12-02 Ruisi Zhang , Youwei Liang , Sai Ashish Somayajula , Pengtao Xie

Neural architecture search (NAS) has shown encouraging results in automating the architecture design. Recently, DARTS relaxes the search process with a differentiable formulation that leverages weight-sharing and SGD where all candidate…

Machine Learning · Computer Science 2022-01-28 Weijun Hong , Guilin Li , Weinan Zhang , Ruiming Tang , Yunhe Wang , Zhenguo Li , Yong Yu

Recently, differentiable search methods have made major progress in reducing the computational costs of neural architecture search. However, these approaches often report lower accuracy in evaluating the searched architecture or…

Computer Vision and Pattern Recognition · Computer Science 2019-04-30 Xin Chen , Lingxi Xie , Jun Wu , Qi Tian

Eye movement biometrics is a secure and innovative identification method. Deep learning methods have shown good performance, but their network architecture relies on manual design and combined priori knowledge. To address these issues, we…

Computer Vision and Pattern Recognition · Computer Science 2024-09-19 Hongyu Zhu , Xin Jin , Hongchao Liao , Yan Xiang , Mounim A. El-Yacoubi , Huafeng Qin

Differentiable Architecture Search (DARTS) has attracted extensive attention due to its efficiency in searching for cell structures. DARTS mainly focuses on the operation search and derives the cell topology from the operation weights.…

Computer Vision and Pattern Recognition · Computer Science 2021-04-09 Yu-Chao Gu , Li-Juan Wang , Yun Liu , Yi Yang , Yu-Huan Wu , Shao-Ping Lu , Ming-Ming Cheng

This work introduces improvements to the stability and generalizability of Cyclic DARTS (CDARTS). CDARTS is a Differentiable Architecture Search (DARTS)-based approach to neural architecture search (NAS) that uses a cyclic feedback…

Machine Learning · Computer Science 2023-09-06 Emily Herron , Derek Rose , Steven Young

Reliable yet efficient evaluation of generalisation performance of a proposed architecture is crucial to the success of neural architecture search (NAS). Traditional approaches face a variety of limitations: training each architecture to…

Machine Learning · Statistics 2021-06-09 Binxin Ru , Clare Lyle , Lisa Schut , Miroslav Fil , Mark van der Wilk , Yarin Gal

Network architecture search (NAS), in particular the differentiable architecture search (DARTS) method, has shown a great power to learn excellent model architectures on the specific dataset of interest. In contrast to using a fixed…

Computer Vision and Pattern Recognition · Computer Science 2022-09-22 Xuhong Ren , Jianlang Chen , Felix Juefei-Xu , Wanli Xue , Qing Guo , Lei Ma , Jianjun Zhao , Shengyong Chen