English
Related papers

Related papers: Making Differentiable Architecture Search less loc…

200 papers

In this paper, we attempt to address the challenge of applying Neural Architecture Search (NAS) algorithms, specifically the Differentiable Architecture Search (DARTS), to long-tailed datasets where class distribution is highly imbalanced.…

Machine Learning · Computer Science 2024-06-12 Chenxia Tang

Differentiable ARchiTecture Search (DARTS) has attracted much attention due to its simplicity and significant improvement in efficiency. However, the excessive accumulation of the skip connection, when training epochs become large, makes it…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Chao Li , Jia Ning , Han Hu , Kun He

Neural Architecture Search (NAS), aiming at automatically designing network architectures by machines, is hoped and expected to bring about a new revolution in machine learning. Despite these high expectation, the effectiveness and…

Computer Vision and Pattern Recognition · Computer Science 2020-03-09 Changlin Li , Jiefeng Peng , Liuchun Yuan , Guangrun Wang , Xiaodan Liang , Liang Lin , Xiaojun Chang

Neural Architecture Search (NAS) is a powerful tool for automating architecture design. One-Shot NAS techniques, such as DARTS, have gained substantial popularity due to their combination of search efficiency with simplicity of…

Machine Learning · Computer Science 2025-05-21 Pavel Rumiantsev , Mark Coates

Eye movement biometrics is a secure and innovative identification method. Deep learning methods have shown good performance, but their network architecture relies on manual design and combined priori knowledge. To address these issues, we…

Computer Vision and Pattern Recognition · Computer Science 2024-09-19 Hongyu Zhu , Xin Jin , Hongchao Liao , Yan Xiang , Mounim A. El-Yacoubi , Huafeng Qin

Neural architecture search (NAS) methods rely on a search strategy for deciding which architectures to evaluate next and a performance estimation strategy for assessing their performance (e.g., using full evaluations, multi-fidelity…

Neural and Evolutionary Computing · Computer Science 2021-08-10 Noor Awad , Neeratyoy Mallik , Frank Hutter

Differentiable neural architecture search (DARTS), as a gradient-guided search method, greatly reduces the cost of computation and speeds up the search. In DARTS, the architecture parameters are introduced to the candidate operations, but…

Machine Learning · Computer Science 2022-08-02 Yu Xue , Jiafeng Qin

Neural Architecture Search (NAS), the process of automating architecture engineering, is an appealing next step to advancing end-to-end Automatic Speech Recognition (ASR), replacing expert-designed networks with learned, task-specific…

Audio and Speech Processing · Electrical Eng. & Systems 2020-11-12 Huahuan Zheng , Keyu An , Zhijian Ou

Traditional neural architecture search (NAS) has a significant impact in computer vision by automatically designing network architectures for various tasks. In this paper, binarized neural architecture search (BNAS), with a search space of…

Computer Vision and Pattern Recognition · Computer Science 2020-09-10 Hanlin Chen , Li'an Zhuo , Baochang Zhang , Xiawu Zheng , Jianzhuang Liu , Rongrong Ji , David Doermann , Guodong Guo

Recent advances in Neural Architecture Search (NAS) such as one-shot NAS offer the ability to extract specialized hardware-aware sub-network configurations from a task-specific super-network. While considerable effort has been employed…

Machine Learning · Computer Science 2022-05-24 Daniel Cummings , Anthony Sarah , Sharath Nittur Sridhar , Maciej Szankin , Juan Pablo Munoz , Sairam Sundaresan

While neural architecture search (NAS) has enabled automated machine learning (AutoML) for well-researched areas, its application to tasks beyond computer vision is still under-explored. As less-studied domains are precisely those where we…

Machine Learning · Computer Science 2022-10-11 Junhong Shen , Mikhail Khodak , Ameet Talwalkar

Differentiable Architecture Search (DARTS) has attracted extensive attention due to its efficiency in searching for cell structures. DARTS mainly focuses on the operation search and derives the cell topology from the operation weights.…

Computer Vision and Pattern Recognition · Computer Science 2021-04-09 Yu-Chao Gu , Li-Juan Wang , Yun Liu , Yi Yang , Yu-Huan Wu , Shao-Ping Lu , Ming-Ming Cheng

Neural Architecture Search (NAS) enabled the discovery of state-of-the-art architectures in many domains. However, the success of NAS depends on the definition of the search space. Current search spaces are defined as a static sequence of…

Machine Learning · Computer Science 2019-08-01 Stanisław Jastrzębski , Quentin de Laroussilhe , Mingxing Tan , Xiao Ma , Neil Houlsby , Andrea Gesmundo

In the past decade, advances in deep learning have resulted in breakthroughs in a variety of areas, including computer vision, natural language understanding, speech recognition, and reinforcement learning. Specialized, high-performing…

Machine Learning · Computer Science 2023-01-26 Colin White , Mahmoud Safari , Rhea Sukthanker , Binxin Ru , Thomas Elsken , Arber Zela , Debadeepta Dey , Frank Hutter

In the past few years, neural architecture search (NAS) has become an increasingly important tool within the deep learning community. Despite the many recent successes of NAS, however, most existing approaches operate within highly…

Machine Learning · Computer Science 2022-11-14 Charles Jin , Phitchaya Mangpo Phothilimthana , Sudip Roy

DARTS search space (DSS) has become a canonical benchmark for NAS whereas some emerging works pointed out the issue of narrow accuracy range and claimed it would hurt the method ranking. We observe some recent studies already suffer from…

Machine Learning · Computer Science 2023-06-13 Jiuling Zhang , Zhiming Ding

Neural Architecture Search (NAS) has emerged as a favoured method for unearthing effective neural architectures. Recent development of large models has intensified the demand for faster search speeds and more accurate search results.…

Machine Learning · Computer Science 2023-11-14 Wang Qinsi , Ke Jinghan , Liang Zhi , Zhang Sihai

Neural architecture search (NAS) has become increasingly popular in the deep learning community recently, mainly because it can provide an opportunity to allow interested users without rich expertise to benefit from the success of deep…

Machine Learning · Computer Science 2022-10-25 Shiqing Liu , Haoyu Zhang , Yaochu Jin

Automatic methods for generating state-of-the-art neural network architectures without human experts have generated significant attention recently. This is because of the potential to remove human experts from the design loop which can…

Machine Learning · Computer Science 2019-11-22 George Adam , Jonathan Lorraine

The rapid proliferation of computing domains relying on Internet of Things (IoT) devices has created a pressing need for efficient and accurate deep-learning (DL) models that can run on low-power devices. However, traditional DL models tend…