English
Related papers

Related papers: DARTS+: Improved Differentiable Architecture Searc…

200 papers

Eye movement biometrics has received increasing attention thanks to its highly secure identification. Although deep learning (DL) models have shown success in eye movement recognition, their architectures largely rely on human prior…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Huafeng Qin , Hongyu Zhu , Xin Jin , Xin Yu , Mounim A. El-Yacoubi , Shuqiang Yang

Differentiable architecture search (DARTS) yields highly efficient gradient-based neural architecture search (NAS) by relaxing the discrete operation selection to optimize continuous architecture parameters that maps NAS from the discrete…

Machine Learning · Computer Science 2023-06-13 Jiuling Zhang , Zhiming Ding

Despite the increasing interest in neural architecture search (NAS), the significant computational cost of NAS is a hindrance to researchers. Hence, we propose to reduce the cost of NAS using proxy data, i.e., a representative subset of the…

Machine Learning · Computer Science 2021-06-10 Byunggook Na , Jisoo Mok , Hyeokjun Choe , Sungroh Yoon

Neural architecture search (NAS) has shown encouraging results in automating the architecture design. Recently, DARTS relaxes the search process with a differentiable formulation that leverages weight-sharing and SGD where all candidate…

Machine Learning · Computer Science 2022-01-28 Weijun Hong , Guilin Li , Weinan Zhang , Ruiming Tang , Yunhe Wang , Zhenguo Li , Yong Yu

Neural Architecture Search has attracted increasing attention in recent years. Among them, differential NAS approaches such as DARTS, have gained popularity for the search efficiency. However, they still suffer from three main issues, that…

Machine Learning · Computer Science 2023-01-18 Peng Ye , Tong He , Baopu Li , Tao Chen , Lei Bai , Wanli Ouyang

Differentiable Neural Architecture Search is one of the most popular Neural Architecture Search (NAS) methods for its search efficiency and simplicity, accomplished by jointly optimizing the model weight and architecture parameters in a…

Machine Learning · Computer Science 2021-08-11 Ruochen Wang , Minhao Cheng , Xiangning Chen , Xiaocheng Tang , Cho-Jui Hsieh

Differentiable Architecture Search (DARTS) has attracted extensive attention due to its efficiency in searching for cell structures. DARTS mainly focuses on the operation search and derives the cell topology from the operation weights.…

Computer Vision and Pattern Recognition · Computer Science 2021-04-09 Yu-Chao Gu , Li-Juan Wang , Yun Liu , Yi Yang , Yu-Huan Wu , Shao-Ping Lu , Ming-Ming Cheng

In the past few years, Differentiable Neural Architecture Search (DNAS) rapidly imposed itself as the trending approach to automate the discovery of deep neural network architectures. This rise is mainly due to the popularity of DARTS, one…

Machine Learning · Computer Science 2023-05-02 Alexandre Heuillet , Ahmad Nasser , Hichem Arioui , Hedi Tabia

Eye movement biometrics is a secure and innovative identification method. Deep learning methods have shown good performance, but their network architecture relies on manual design and combined priori knowledge. To address these issues, we…

Computer Vision and Pattern Recognition · Computer Science 2024-09-19 Hongyu Zhu , Xin Jin , Hongchao Liao , Yan Xiang , Mounim A. El-Yacoubi , Huafeng Qin

Neural Architecture Search~(NAS) has attracted increasingly more attention in recent years because of its capability to design deep neural networks automatically. Among them, differential NAS approaches such as DARTS, have gained popularity…

Machine Learning · Computer Science 2022-03-07 Peng Ye , Baopu Li , Yikang Li , Tao Chen , Jiayuan Fan , Wanli Ouyang

The deployment of Deep Neural Networks (DNNs) on edge devices is hindered by the substantial gap between performance requirements and available processing power. While recent research has made significant strides in developing pruning…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Hamid Mousavi , Mohammad Loni , Mina Alibeigi , Masoud Daneshtalab

Designing effective neural networks is a cornerstone of deep learning, and Neural Architecture Search (NAS) has emerged as a powerful tool for automating this process. Among the existing NAS approaches, Differentiable Architecture Search…

Machine Learning · Computer Science 2025-07-18 Pengjin Wu , Ferrante Neri , Zhenhua Feng

Speech Emotion Recognition (SER) is a critical enabler of emotion-aware communication in human-computer interactions. Recent advancements in Deep Learning (DL) have substantially enhanced the performance of SER models through increased…

Sound · Computer Science 2024-01-22 Thejan Rajapakshe , Rajib Rana , Sara Khalifa , Berrak Sisman , Björn Schuller

Integrating the principles of approximate computing into the design of hardware-aware deep neural networks (DNN) has led to DNNs implementations showing good output quality and highly optimized hardware parameters such as low latency or…

Machine Learning · Computer Science 2025-10-23 Michal Pinos , Lukas Sekanina , Vojtech Mrazek

Neural architecture search (NAS) has been successfully applied to tasks like image classification and language modeling for finding efficient high-performance network architectures. In ASR field especially end-to-end ASR, the related…

Sound · Computer Science 2021-08-11 Xian Shi , Pan Zhou , Wei Chen , Lei Xie

In this paper, we attempt to address the challenge of applying Neural Architecture Search (NAS) algorithms, specifically the Differentiable Architecture Search (DARTS), to long-tailed datasets where class distribution is highly imbalanced.…

Machine Learning · Computer Science 2024-06-12 Chenxia Tang

While recent NAS algorithms are thousands of times faster than the pioneering works, it is often overlooked that they use fewer candidate operations, resulting in a significantly smaller search space. We present PR-DARTS, a NAS algorithm…

Machine Learning · Computer Science 2021-04-23 Kevin Alexander Laube , Andreas Zell

Graph Transformers (GTs) have emerged as powerful architectures for graph-structured data, yet remain constrained by rigid designs and lack quantifiable interpretability. Current state-of-the-art GTs commit to fixed GNN types across all…

Machine Learning · Computer Science 2025-11-03 Shruti Sarika Chakraborty , Peter Minary

Differentiable Neural Architecture Search (NAS) provides efficient, gradient-based methods for automatically designing neural networks, yet its adoption remains limited in practice. We present MIDAS, a novel approach that modernizes DARTS…

Machine Learning · Computer Science 2026-02-23 Konstanty Subbotko

Recently neural architecture search(NAS) has been successfully used in image classification, natural language processing, and automatic speech recognition(ASR) tasks for finding the state-of-the-art(SOTA) architectures than those…

Audio and Speech Processing · Electrical Eng. & Systems 2021-04-14 Yukun Liu , Ta Li , Pengyuan Zhang , Yonghong Yan