English
Related papers

Related papers: Improved Conformer-based End-to-End Speech Recogni…

200 papers

Neural architecture search (NAS) has been successfully applied to tasks like image classification and language modeling for finding efficient high-performance network architectures. In ASR field especially end-to-end ASR, the related…

Sound · Computer Science 2021-08-11 Xian Shi , Pan Zhou , Wei Chen , Lei Xie

Neural Architecture Search (NAS), the process of automating architecture engineering, is an appealing next step to advancing end-to-end Automatic Speech Recognition (ASR), replacing expert-designed networks with learned, task-specific…

Audio and Speech Processing · Electrical Eng. & Systems 2020-11-12 Huahuan Zheng , Keyu An , Zhijian Ou

In previous works, only parameter weights of ASR models are optimized under fixed-topology architecture. However, the design of successful model architecture has always relied on human experience and intuition. Besides, many hyperparameters…

Audio and Speech Processing · Electrical Eng. & Systems 2020-07-28 Yi-Chen Chen , Jui-Yang Hsu , Cheng-Kuang Lee , Hung-yi Lee

Neural Architecture Search (NAS) has been a source of dramatic improvements in neural network design, with recent results meeting or exceeding the performance of hand-tuned architectures. However, our understanding of how to represent the…

Computer Vision and Pattern Recognition · Computer Science 2019-03-26 Andrew Hundt , Varun Jain , Gregory D. Hager

Neural architecture search (NAS) recently attracts much research attention because of its ability to identify better architectures than handcrafted ones. However, many NAS methods, which optimize the search process in a discrete search…

Machine Learning · Computer Science 2019-11-22 Quanming Yao , Ju Xu , Wei-Wei Tu , Zhanxing Zhu

Neural architecture search (NAS) is a recent methodology for automating the design of neural network architectures. Differentiable neural architecture search (DARTS) is a promising NAS approach that dramatically increases search efficiency.…

Machine Learning · Computer Science 2021-04-22 Erik Bodin , Federico Tomasi , Zhenwen Dai

Speech Emotion Recognition (SER) is a critical enabler of emotion-aware communication in human-computer interactions. Recent advancements in Deep Learning (DL) have substantially enhanced the performance of SER models through increased…

Sound · Computer Science 2024-01-22 Thejan Rajapakshe , Rajib Rana , Sara Khalifa , Berrak Sisman , Björn Schuller

In this paper, we explore the neural architecture search (NAS) for automatic speech recognition (ASR) systems. With reference to the previous works in the computer vision field, the transferability of the searched architecture is the main…

Audio and Speech Processing · Electrical Eng. & Systems 2021-05-11 Liqiang He , Dan Su , Dong Yu

In this paper, we investigate the fundamental question: To what extent are gradient-based neural architecture search (NAS) techniques applicable to RL? Using the original DARTS as a convenient baseline, we discover that the discrete…

Machine Learning · Computer Science 2022-11-16 Yingjie Miao , Xingyou Song , John D. Co-Reyes , Daiyi Peng , Summer Yue , Eugene Brevdo , Aleksandra Faust

Differentiable Architecture Search (DARTS) is a simple yet efficient Neural Architecture Search (NAS) method. During the search stage, DARTS trains a supernet by jointly optimizing architecture parameters and network parameters. During the…

Computer Vision and Pattern Recognition · Computer Science 2023-09-04 Xunyu Zhu , Jian Li , Yong Liu , Weiping Wang

State-of-the-art automatic speech recognition (ASR) system development is data and computation intensive. The optimal design of deep neural networks (DNNs) for these systems often require expert knowledge and empirical evaluation. In this…

Audio and Speech Processing · Electrical Eng. & Systems 2022-03-30 Shoukang Hu , Xurong Xie , Mingyu Cui , Jiajun Deng , Shansong Liu , Jianwei Yu , Mengzhe Geng , Xunying Liu , Helen Meng

Differentiable Architecture Search (DARTS) has received massive attention in recent years, mainly because it significantly reduces the computational cost through weight sharing and continuous relaxation. However, more recent works find that…

Machine Learning · Computer Science 2021-11-29 Miao Zhang , Jilin Hu , Steven Su , Shirui Pan , Xiaojun Chang , Bin Yang , Gholamreza Haffari

Neural architecture search (NAS) searches architectures automatically for given tasks, e.g., image classification and language modeling. Improving the search efficiency and effectiveness have attracted increasing attention in recent years.…

Machine Learning · Computer Science 2020-01-03 Yao Shu , Wei Wang , Shaofeng Cai

Spiking Neural Networks (SNNs) have gained enormous popularity in the field of artificial intelligence due to their low power consumption. However, the majority of SNN methods directly inherit the structure of Artificial Neural Networks…

Neural and Evolutionary Computing · Computer Science 2024-11-05 Yilei Man , Linhai Xie , Shushan Qiao , Yumei Zhou , Delong Shang

Neural architecture search (NAS) aims to discover network architectures with desired properties such as high accuracy or low latency. Recently, differentiable NAS (DNAS) has demonstrated promising results while maintaining a search cost…

Machine Learning · Computer Science 2020-08-31 Arash Vahdat , Arun Mallya , Ming-Yu Liu , Jan Kautz

Deep neural networks (DNNs) based automatic speech recognition (ASR) systems are often designed using expert knowledge and empirical evaluation. In this paper, a range of neural architecture search (NAS) techniques are used to automatically…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-09 Shoukang Hu , Xurong Xie , Shansong Liu , Mingyu Cui , Mengzhe Geng , Xunying Liu , Helen Meng

Differentiable Architecture Search (DARTS) is an effective continuous relaxation-based network architecture search (NAS) method with low search cost. It has attracted significant attentions in Auto-ML research and becomes one of the most…

Artificial Intelligence · Computer Science 2022-03-10 Jun-Wei Hsieh , Ming-Ching Chang , Ping-Yang Chen , Santanu Santra , Cheng-Han Chou , Chih-Sheng Huang

Neural architecture search (NAS) has gained significant traction in automating the design of neural networks. To reduce search time, differentiable architecture search (DAS) reframes the traditional paradigm of discrete candidate sampling…

Machine Learning · Computer Science 2025-11-26 Xiaoyun Liu , Divya Saxena , Jiannong Cao , Yuqing Zhao , Penghui Ruan

Differentiable architecture search (DARTS) has emerged as a promising technique for effective neural architecture search, and it mainly contains two steps to find the high-performance architecture: First, the DARTS supernet that consists of…

Artificial Intelligence · Computer Science 2024-09-24 Le Yang , Ziwei Zheng , Yizeng Han , Shiji Song , Gao Huang , Fan Li

Differentiable architecture search (DARTS) has been a popular one-shot paradigm for NAS due to its high efficiency. It introduces trainable architecture parameters to represent the importance of candidate operations and proposes…

Computer Vision and Pattern Recognition · Computer Science 2022-02-01 Xiaoxing Wang , Wenxuan Guo , Junchi Yan , Jianlin Su , Xiaokang Yang
‹ Prev 1 2 3 10 Next ›