中文
相关论文

相关论文: Cyclic Differentiable Architecture Search

200 篇论文

Differentiable architecture search (DARTS) is widely considered to be easy to overfit the validation set which leads to performance degradation. We first employ a series of exploratory experiments to verify that neither high-strength…

机器学习 · 计算机科学 2021-09-29 Jiuling Zhang , Zhiming Ding

Differentiable architecture search (DAS) has made great progress in searching for high-performance architectures with reduced computational cost. However, DAS-based methods mainly focus on searching for a repeatable cell structure, which is…

计算机视觉与模式识别 · 计算机科学 2021-01-13 Guanting Liu , Yujie Zhong , Sheng Guo , Matthew R. Scott , Weilin Huang

Improving the efficiency of Neural Architecture Search (NAS) is a challenging but significant task that has received much attention. Previous works mainly adopted the Differentiable Architecture Search (DARTS) and improved its search…

计算机视觉与模式识别 · 计算机科学 2023-12-25 Chongjun Tu , Peng Ye , Weihao Lin , Hancheng Ye , Chong Yu , Tao Chen , Baopu Li , Wanli Ouyang

Most applications demand high-performance deep neural architectures costing limited resources. Neural architecture searching is a way of automatically exploring optimal deep neural networks in a given huge search space. However, all…

机器学习 · 计算机科学 2020-06-01 Yunhe Wang , Yixing Xu , Dacheng Tao

Neural architecture search (NAS) methods aim to automatically find the optimal deep neural network (DNN) architecture as measured by a given objective function, typically some combination of task accuracy and inference efficiency. For many…

In differentiable neural architecture search (NAS) algorithms like DARTS, the training set used to update model weight and the validation set used to update model architectures are sampled from the same data distribution. Thus, the uncommon…

机器学习 · 计算机科学 2021-12-02 Ruisi Zhang , Youwei Liang , Sai Ashish Somayajula , Pengtao Xie

Neural architecture search has shown its great potential in various areas recently. However, existing methods rely heavily on a black-box controller to search architectures, which suffers from the serious problem of lacking…

机器学习 · 计算机科学 2020-09-29 Xinyue Zheng , Peng Wang , Qigang Wang , Zhongchao Shi

Transferrable neural architecture search can be viewed as a binary optimization problem where a single optimal path should be selected among candidate paths in each edge within the repeated cell block of the directed a cyclic graph form.…

计算机视觉与模式识别 · 计算机科学 2019-12-05 Hyeong Gwon Hong , Pyunghwan Ahn , Junmo Kim

Speech Emotion Recognition (SER) is crucial for enabling computers to understand the emotions conveyed in human communication. With recent advancements in Deep Learning (DL), the performance of SER models has significantly improved.…

声音 · 计算机科学 2024-08-09 Thejan Rajapakshe , Rajib Rana , Sara Khalifa , Berrak Sisman , Bjorn W. Schuller , Carlos Busso

Neural architecture search (NAS) searches architectures automatically for given tasks, e.g., image classification and language modeling. Improving the search efficiency and effectiveness have attracted increasing attention in recent years.…

机器学习 · 计算机科学 2020-01-03 Yao Shu , Wei Wang , Shaofeng Cai

Differentiable Architecture Search (DARTS) has attracted extensive attention due to its efficiency in searching for cell structures. DARTS mainly focuses on the operation search and derives the cell topology from the operation weights.…

计算机视觉与模式识别 · 计算机科学 2021-04-09 Yu-Chao Gu , Li-Juan Wang , Yun Liu , Yi Yang , Yu-Huan Wu , Shao-Ping Lu , Ming-Ming Cheng

Convolutional neural networks (CNNs) have shown good performance in polarimetric synthetic aperture radar (PolSAR) image classification due to the automation of feature engineering. Excellent hand-crafted architectures of CNNs incorporated…

计算机视觉与模式识别 · 计算机科学 2020-12-16 Hongwei Dong , Siyu Zhang , Bin Zou , Lamei Zhang

Neural structure search (NAS), as the mainstream approach to automate deep neural architecture design, has achieved much success in recent years. However, the performance estimation component adhering to NAS is often prohibitively costly,…

机器学习 · 计算机科学 2022-04-27 Zixuan Liang , Yanan Sun

In the past few years, Differentiable Neural Architecture Search (DNAS) rapidly imposed itself as the trending approach to automate the discovery of deep neural network architectures. This rise is mainly due to the popularity of DARTS, one…

机器学习 · 计算机科学 2023-05-02 Alexandre Heuillet , Ahmad Nasser , Hichem Arioui , Hedi Tabia

Neural architecture search (NAS) has been successfully applied to tasks like image classification and language modeling for finding efficient high-performance network architectures. In ASR field especially end-to-end ASR, the related…

声音 · 计算机科学 2021-08-11 Xian Shi , Pan Zhou , Wei Chen , Lei Xie

Neural architecture search (NAS) can have a significant impact in computer vision by automatically designing optimal neural network architectures for various tasks. A variant, binarized neural architecture search (BNAS), with a search space…

计算机视觉与模式识别 · 计算机科学 2020-02-12 Hanlin Chen , Li'an Zhuo , Baochang Zhang , Xiawu Zheng , Jianzhuang Liu , David Doermann , Rongrong Ji

Neural architecture search (NAS) has shown encouraging results in automating the architecture design. Recently, DARTS relaxes the search process with a differentiable formulation that leverages weight-sharing and SGD where all candidate…

机器学习 · 计算机科学 2022-01-28 Weijun Hong , Guilin Li , Weinan Zhang , Ruiming Tang , Yunhe Wang , Zhenguo Li , Yong Yu

Integrating the principles of approximate computing into the design of hardware-aware deep neural networks (DNN) has led to DNNs implementations showing good output quality and highly optimized hardware parameters such as low latency or…

机器学习 · 计算机科学 2025-10-23 Michal Pinos , Lukas Sekanina , Vojtech Mrazek

Neural architecture search (NAS) has shown great promise in the field of automated machine learning (AutoML). NAS has outperformed hand-designed networks and made a significant step forward in the field of automating the design of deep…

机器学习 · 计算机科学 2022-05-16 Matej Grobelnik , Joaquin Vanschoren

Binary Neural Networks (BNNs) have received significant attention due to their promising efficiency. Currently, most BNN studies directly adopt widely-used CNN architectures, which can be suboptimal for BNNs. This paper proposes a novel…

人工智能 · 计算机科学 2021-03-30 Tianchen Zhao , Xuefei Ning , Xiangsheng Shi , Songyi Yang , Shuang Liang , Peng Lei , Jianfei Chen , Huazhong Yang , Yu Wang