中文
相关论文

相关论文: Encoder-Decoder Neural Architecture Optimization f…

200 篇论文

This paper introduces neural architecture search (NAS) for the automatic discovery of end-to-end keyword spotting (KWS) models in limited resource environments. We employ a differentiable NAS approach to optimize the structure of…

声音 · 计算机科学 2021-04-15 David Peter , Wolfgang Roth , Franz Pernkopf

In this paper, we propose a deep convolutional neural network-based acoustic word embedding system on code-switching query by example spoken term detection. Different from previous configurations, we combine audio data in two languages for…

音频与语音处理 · 电气工程与系统科学 2020-05-26 Murong Ma , Haiwei Wu , Xuyang Wang , Lin Yang , Junjie Wang , Ming Li

The paper presents a method for spoken term detection based on the Transformer architecture. We propose the encoder-encoder architecture employing two BERT-like encoders with additional modifications, including convolutional and upsampling…

计算与语言 · 计算机科学 2022-11-03 Jan Švec , Luboš Šmídl , Jan Lehečka

The automation of feature extraction of machine learning has been successfully realized by the explosive development of deep learning. However, the structures and hyperparameters of deep neural network architectures also make huge…

机器学习 · 计算机科学 2024-10-01 Wenzhu Shao

In this research, we advanced a spoken language recognition system, moving beyond traditional feature vector-based models. Our improvements focused on effectively capturing language characteristics over extended periods using a specialized…

声音 · 计算机科学 2025-01-22 Or Haim Anidjar , Roi Yozevitch

Convolutional neural networks typically encode an input image into a series of intermediate features with decreasing resolutions. While this structure is suited to classification tasks, it does not perform well for tasks requiring…

计算机视觉与模式识别 · 计算机科学 2020-06-18 Xianzhi Du , Tsung-Yi Lin , Pengchong Jin , Golnaz Ghiasi , Mingxing Tan , Yin Cui , Quoc V. Le , Xiaodan Song

Deep Neural Network--Hidden Markov Model (DNN-HMM) based methods have been successfully used for many always-on keyword spotting algorithms that detect a wake word to trigger a device. The DNN predicts the state probabilities of a given…

声音 · 计算机科学 2021-03-01 Ashish Shrivastava , Arnav Kundu , Chandra Dhir , Devang Naik , Oncel Tuzel

This paper presents a deep learning architecture for the semantic decoder component of a Statistical Spoken Dialogue System. In a slot-filling dialogue, the semantic decoder predicts the dialogue act and a set of slot-value pairs from a set…

Attention-based recurrent neural encoder-decoder models present an elegant solution to the automatic speech recognition problem. This approach folds the acoustic model, pronunciation model, and language model into a single network and…

音频与语音处理 · 电气工程与系统科学 2018-11-08 Shubham Toshniwal , Anjuli Kannan , Chung-Cheng Chiu , Yonghui Wu , Tara N Sainath , Karen Livescu

Using audio and text embeddings jointly for Keyword Spotting (KWS) has shown high-quality results, but the key challenge of how to semantically align two embeddings for multi-word keywords of different sequence lengths remains largely…

音频与语音处理 · 电气工程与系统科学 2023-06-09 Kumari Nishu , Minsik Cho , Devang Naik

This paper introduces neural architecture search (NAS) for the automatic discovery of small models for keyword spotting (KWS) in limited resource environments. We employ a differentiable NAS approach to optimize the structure of…

音频与语音处理 · 电气工程与系统科学 2020-12-21 David Peter , Wolfgang Roth , Franz Pernkopf

Transformer-based models have achieved stateof-the-art results in many tasks in natural language processing. However, such models are usually slow at inference time, making deployment difficult. In this paper, we develop an efficient…

机器学习 · 计算机科学 2020-08-18 Henry Tsai , Jayden Ooi , Chun-Sung Ferng , Hyung Won Chung , Jason Riesa

Dense Convolutional Network has been continuously refined to adopt a highly efficient and compact architecture, owing to its lightweight and efficient structure. However, the current Dense-like architectures are mainly designed manually, it…

计算机视觉与模式识别 · 计算机科学 2024-10-11 Liu Tianyuan , Hou Libin , Wang Linyuan , Song Xiyu , Yan Bin

Despite the recent successes of deep neural networks, it remains challenging to achieve high precision keyword spotting task (KWS) on resource-constrained devices. In this study, we propose a novel context-aware and compact architecture for…

声音 · 计算机科学 2019-12-12 Xi Chen , Shouyi Yin , Dandan Song , Peng Ouyang , Leibo Liu , Shaojun Wei

Deep learning has shown promising results on many machine learning tasks but DL models are often complex networks with large number of neurons and layers, and recently, complex layer structures known as building blocks. Finding the best…

机器学习 · 计算机科学 2018-01-29 Jayanta K Dutta , Jiayi Liu , Unmesh Kurup , Mohak Shah

Automatic search of neural network architectures is a standing research topic. In addition to the fact that it presents a faster alternative to hand-designed architectures, it can improve their efficiency and for instance generate…

计算机视觉与模式识别 · 计算机科学 2019-02-06 Guillaume Michel , Mohammed Amine Alaoui , Alice Lebois , Amal Feriani , Mehdi Felhi

In this paper, we propose a context-aware keyword spotting model employing a character-level recurrent neural network (RNN) for spoken term detection in continuous speech. The RNN is end-to-end trained with connectionist temporal…

计算与语言 · 计算机科学 2015-12-31 Kyuyeon Hwang , Minjae Lee , Wonyong Sung

This study presents a novel zero-shot user-defined keyword spotting model that utilizes the audio-phoneme relationship of the keyword to improve performance. Unlike the previous approach that estimates at utterance level, we use both…

音频与语音处理 · 电气工程与系统科学 2023-09-01 Yong-Hyeok Lee , Namhyun Cho

The growing interest in both the automation of machine learning and deep learning has inevitably led to the development of a wide variety of automated methods for neural architecture search. The choice of the network architecture has proven…

机器学习 · 计算机科学 2019-06-19 Martin Wistuba , Ambrish Rawat , Tejaswini Pedapati

Semantic code search is the task of retrieving relevant code snippet given a natural language query. Different from typical information retrieval tasks, code search requires to bridge the semantic gap between the programming language and…

计算与语言 · 计算机科学 2022-01-28 Chen Wu , Ming Yan