中文
相关论文

相关论文: Single-DARTS: Towards Stable Architecture Search

200 篇论文

Neural architecture search (NAS) has been successfully applied to tasks like image classification and language modeling for finding efficient high-performance network architectures. In ASR field especially end-to-end ASR, the related…

声音 · 计算机科学 2021-08-11 Xian Shi , Pan Zhou , Wei Chen , Lei Xie

Designing effective neural networks is a cornerstone of deep learning, and Neural Architecture Search (NAS) has emerged as a powerful tool for automating this process. Among the existing NAS approaches, Differentiable Architecture Search…

机器学习 · 计算机科学 2025-07-18 Pengjin Wu , Ferrante Neri , Zhenhua Feng

In this paper, we investigate a new variant of neural architecture search (NAS) paradigm -- searching with random labels (RLNAS). The task sounds counter-intuitive for most existing NAS algorithms since random label provides few information…

计算机视觉与模式识别 · 计算机科学 2021-05-26 Xuanyang Zhang , Pengfei Hou , Xiangyu Zhang , Jian Sun

This paper reports the first successful application of a differentiable architecture search (DARTS) approach to the deepfake and spoofing detection problems. An example of neural architecture search, DARTS operates upon a continuous,…

机器学习 · 计算机科学 2021-07-01 Wanying Ge , Michele Panariello , Jose Patino , Massimiliano Todisco , Nicholas Evans

Neural Architecture Search (NAS), the process of automating architecture engineering, is an appealing next step to advancing end-to-end Automatic Speech Recognition (ASR), replacing expert-designed networks with learned, task-specific…

音频与语音处理 · 电气工程与系统科学 2020-11-12 Huahuan Zheng , Keyu An , Zhijian Ou

There has been a large literature of neural architecture search, but most existing work made use of heuristic rules that largely constrained the search flexibility. In this paper, we first relax these manually designed constraints and…

计算机视觉与模式识别 · 计算机科学 2020-07-08 Kaifeng Bi , Lingxi Xie , Xin Chen , Longhui Wei , Qi Tian

Transferrable neural architecture search can be viewed as a binary optimization problem where a single optimal path should be selected among candidate paths in each edge within the repeated cell block of the directed a cyclic graph form.…

计算机视觉与模式识别 · 计算机科学 2019-12-05 Hyeong Gwon Hong , Pyunghwan Ahn , Junmo Kim

Neural architecture search (NAS) has shown great promise in the field of automated machine learning (AutoML). NAS has outperformed hand-designed networks and made a significant step forward in the field of automating the design of deep…

机器学习 · 计算机科学 2022-05-16 Matej Grobelnik , Joaquin Vanschoren

Speech Emotion Recognition (SER) is a critical enabler of emotion-aware communication in human-computer interactions. Recent advancements in Deep Learning (DL) have substantially enhanced the performance of SER models through increased…

声音 · 计算机科学 2024-01-22 Thejan Rajapakshe , Rajib Rana , Sara Khalifa , Berrak Sisman , Björn Schuller

Neural Architecture Search (NAS) is an automatic technique that can search for well-performed architectures for a specific task. Although NAS surpasses human-designed architecture in many fields, the high computational cost of architecture…

机器学习 · 计算机科学 2022-12-26 Yuqiao Liu , Haipeng Li , Yanan Sun , Shuaicheng Liu

The usefulness and value of Multi-step Machine Learning (ML), where a task is organized into connected sub-tasks with known intermediate inference goals, as opposed to a single large model learned end-to-end without intermediate sub-tasks,…

The rapid proliferation of computing domains relying on Internet of Things (IoT) devices has created a pressing need for efficient and accurate deep-learning (DL) models that can run on low-power devices. However, traditional DL models tend…

This paper proposes Binary ArchitecTure Search (BATS), a framework that drastically reduces the accuracy gap between binary neural networks and their real-valued counterparts by means of Neural Architecture Search (NAS). We show that…

计算机视觉与模式识别 · 计算机科学 2020-07-27 Adrian Bulat , Brais Martinez , Georgios Tzimiropoulos

AI technology has made remarkable achievements in computational pathology (CPath), especially with the help of deep neural networks. However, the network performance is highly related to architecture design, which commonly requires human…

计算机视觉与模式识别 · 计算机科学 2021-08-17 Sheyang Tang , Mahdi S. Hosseini , Lina Chen , Sonal Varma , Corwyn Rowsell , Savvas Damaskinos , Konstantinos N. Plataniotis , Zhou Wang

One-shot neural architecture search (NAS) methods significantly reduce the search cost by considering the whole search space as one network, which only needs to be trained once. However, current methods select each operation independently…

计算机视觉与模式识别 · 计算机科学 2021-03-23 Xiu Su , Tao Huang , Yanxi Li , Shan You , Fei Wang , Chen Qian , Changshui Zhang , Chang Xu

We propose Stochastic Neural Architecture Search (SNAS), an economical end-to-end solution to Neural Architecture Search (NAS) that trains neural operation parameters and architecture distribution parameters in same round of…

机器学习 · 计算机科学 2020-04-02 Sirui Xie , Hehui Zheng , Chunxiao Liu , Liang Lin

Neural Architecture Search (NAS) is an exciting new field which promises to be as much as a game-changer as Convolutional Neural Networks were in 2012. Despite many great works leading to substantial improvements on a variety of tasks,…

机器学习 · 计算机科学 2020-02-17 Antoine Yang , Pedro M. Esperança , Fabio M. Carlucci

We propose to incorporate neural architecture search (NAS) into general-purpose multi-task learning (GP-MTL). Existing NAS methods typically define different search spaces according to different tasks. In order to adapt to different task…

机器学习 · 计算机科学 2020-04-01 Yuan Gao , Haoping Bai , Zequn Jie , Jiayi Ma , Kui Jia , Wei Liu

DARTS search space (DSS) has become a canonical benchmark for NAS whereas some emerging works pointed out the issue of narrow accuracy range and claimed it would hurt the method ranking. We observe some recent studies already suffer from…

机器学习 · 计算机科学 2023-06-13 Jiuling Zhang , Zhiming Ding

Differentiable Architecture Search (DARTS) provides a baseline for searching effective network architectures based gradient, but it is accompanied by huge computational overhead in searching and training network architecture. Recently, many…

机器学习 · 计算机科学 2020-10-19 Zhaowen Wang , Wei Zhang , Zhiming Wang