中文
相关论文

相关论文: Operation-level Progressive Differentiable Archite…

200 篇论文

In this paper, we propose a Shapley value based method to evaluate operation contribution (Shapley-NAS) for neural architecture search. Differentiable architecture search (DARTS) acquires the optimal architectures by optimizing the…

机器学习 · 计算机科学 2022-06-22 Han Xiao , Ziwei Wang , Zheng Zhu , Jie Zhou , Jiwen Lu

Recent advancements in artificial intelligence (AI) have positioned deep learning (DL) as a pivotal technology in fields like computer vision, data mining, and natural language processing. A critical factor in DL performance is the…

机器学习 · 计算机科学 2024-06-26 Jiaming Yan

Designing effective neural networks is a cornerstone of deep learning, and Neural Architecture Search (NAS) has emerged as a powerful tool for automating this process. Among the existing NAS approaches, Differentiable Architecture Search…

机器学习 · 计算机科学 2025-07-18 Pengjin Wu , Ferrante Neri , Zhenhua Feng

In this paper, we investigate the fundamental question: To what extent are gradient-based neural architecture search (NAS) techniques applicable to RL? Using the original DARTS as a convenient baseline, we discover that the discrete…

机器学习 · 计算机科学 2022-11-16 Yingjie Miao , Xingyou Song , John D. Co-Reyes , Daiyi Peng , Summer Yue , Eugene Brevdo , Aleksandra Faust

In this paper, we attempt to address the challenge of applying Neural Architecture Search (NAS) algorithms, specifically the Differentiable Architecture Search (DARTS), to long-tailed datasets where class distribution is highly imbalanced.…

机器学习 · 计算机科学 2024-06-12 Chenxia Tang

Differentiable architecture search (DARTS) yields highly efficient gradient-based neural architecture search (NAS) by relaxing the discrete operation selection to optimize continuous architecture parameters that maps NAS from the discrete…

机器学习 · 计算机科学 2023-06-13 Jiuling Zhang , Zhiming Ding

This work introduces improvements to the stability and generalizability of Cyclic DARTS (CDARTS). CDARTS is a Differentiable Architecture Search (DARTS)-based approach to neural architecture search (NAS) that uses a cyclic feedback…

机器学习 · 计算机科学 2023-09-06 Emily Herron , Derek Rose , Steven Young

This study aims at making the architecture search process more adaptive for one-shot or online training. It is extended from the existing study on differentiable neural architecture search, and we made the backbone architecture…

人工智能 · 计算机科学 2021-06-15 Renlong Jie , Junbin Gao

Neural architecture search (NAS) aims to produce the optimal sparse solution from a high-dimensional space spanned by all candidate connections. Current gradient-based NAS methods commonly ignore the constraint of sparsity in the search…

计算机视觉与模式识别 · 计算机科学 2020-10-14 Yibo Yang , Hongyang Li , Shan You , Fei Wang , Chen Qian , Zhouchen Lin

Despite the increasing interest in neural architecture search (NAS), the significant computational cost of NAS is a hindrance to researchers. Hence, we propose to reduce the cost of NAS using proxy data, i.e., a representative subset of the…

机器学习 · 计算机科学 2021-06-10 Byunggook Na , Jisoo Mok , Hyeokjun Choe , Sungroh Yoon

Convolutional Neural Networks (CNN) have been regarded as a capable class of models for visual recognition problems. Nevertheless, it is not trivial to develop generic and powerful network architectures, which requires significant efforts…

计算机视觉与模式识别 · 计算机科学 2019-09-24 Zhaofan Qiu , Ting Yao , Yiheng Zhang , Yongdong Zhang , Tao Mei

Neural Architecture Search~(NAS) has attracted increasingly more attention in recent years because of its capability to design deep neural networks automatically. Among them, differential NAS approaches such as DARTS, have gained popularity…

机器学习 · 计算机科学 2022-03-07 Peng Ye , Baopu Li , Yikang Li , Tao Chen , Jiayuan Fan , Wanli Ouyang

Strong priors are imposed on the search space of Differentiable Architecture Search (DARTS), such that cells of the same type share the same topological structure and each intermediate node retains two operators from distinct nodes. While…

机器学习 · 计算机科学 2025-04-30 Xuan Rao , Bo Zhao , Derong Liu , Cesare Alippi

Neural architecture search (NAS) has shown encouraging results in automating the architecture design. Recently, DARTS relaxes the search process with a differentiable formulation that leverages weight-sharing and SGD where all candidate…

机器学习 · 计算机科学 2022-01-28 Weijun Hong , Guilin Li , Weinan Zhang , Ruiming Tang , Yunhe Wang , Zhenguo Li , Yong Yu

Neural Architecture Search (NAS) is an automatic technique that can search for well-performed architectures for a specific task. Although NAS surpasses human-designed architecture in many fields, the high computational cost of architecture…

机器学习 · 计算机科学 2022-12-26 Yuqiao Liu , Haipeng Li , Yanan Sun , Shuaicheng Liu

In the past few years, Differentiable Neural Architecture Search (DNAS) rapidly imposed itself as the trending approach to automate the discovery of deep neural network architectures. This rise is mainly due to the popularity of DARTS, one…

机器学习 · 计算机科学 2023-05-02 Alexandre Heuillet , Ahmad Nasser , Hichem Arioui , Hedi Tabia

Speech Emotion Recognition (SER) is a critical enabler of emotion-aware communication in human-computer interactions. Recent advancements in Deep Learning (DL) have substantially enhanced the performance of SER models through increased…

声音 · 计算机科学 2024-01-22 Thejan Rajapakshe , Rajib Rana , Sara Khalifa , Berrak Sisman , Björn Schuller

Solving partial differential equations (PDEs) has been indispensable in scientific and engineering applications. Recently, deep learning methods have been widely used to solve high-dimensional problems, one of which is the physics-informed…

数值分析 · 数学 2025-04-16 Qing Li , Jingrun Chen

Existing neural architecture search (NAS) methods often return an architecture with good search performance but generalizes poorly to the test setting. To achieve better generalization, we propose a novel neighborhood-aware NAS formulation…

机器学习 · 计算机科学 2021-11-01 Xiaofang Wang , Shengcao Cao , Mengtian Li , Kris M. Kitani

Neural Architecture Search (NAS) has attracted growing interest. To reduce the search cost, recent work has explored weight sharing across models and made major progress in One-Shot NAS. However, it has been observed that a model with…

计算机视觉与模式识别 · 计算机科学 2021-12-17 Xin Xia , Xuefeng Xiao , Xing Wang , Min Zheng