English
Related papers

Related papers: Few-shot learning with attention-based sequence-to…

200 papers

End-to-end automatic speech recognition (ASR) models, including both attention-based models and the recurrent neural network transducer (RNN-T), have shown superior performance compared to conventional systems. However, previous studies…

In this paper, we propose an attention-based end-to-end model for multi-channel keyword spotting (KWS), which is trained to optimize the KWS result directly. As a result, our model outperforms the baseline model with signal pre-processing…

Sound · Computer Science 2018-11-06 Haitong Zhang , Junbo Zhang , Yujun Wang

This paper presents a novel streaming end-to-end target-speaker speech recognition that addresses two critical limitations in systems: the handling of noisy enrollment utterances and specific enrollment phrase requirements. This paper…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-28 Mohsen Ghane , Mohammad Sadegh Safari

Transformer-based large language models exhibit in-context learning, enabling adaptation to downstream tasks via few-shot prompting with demonstrations. In practice, such models are often fine-tuned to improve zero-shot performance on…

Computation and Language · Computer Science 2026-02-27 Chungpa Lee , Jy-yong Sohn , Kangwook Lee

In this paper, we propose a novel end-to-end user-defined keyword spotting method that utilizes linguistically corresponding patterns between speech and text sequences. Unlike previous approaches requiring speech keyword enrollment, our…

Audio and Speech Processing · Electrical Eng. & Systems 2022-07-04 Hyeon-Kyeong Shin , Hyewon Han , Doyeon Kim , Soo-Whan Chung , Hong-Goo Kang

In this paper, we propose a novel end-to-end sequence-to-sequence spoken language understanding model using an attention mechanism. It reliably selects contextual acoustic features in order to hypothesize semantic contents. An initial…

Computation and Language · Computer Science 2021-05-20 Valentin Pelloin , Nathalie Camelin , Antoine Laurent , Renato De Mori , Antoine Caubrière , Yannick Estève , Sylvain Meignier

The focus of recent meta-learning research has been on the development of learning algorithms that can quickly adapt to test time tasks with limited data and low computational cost. Few-shot learning is widely used as one of the standard…

Computer Vision and Pattern Recognition · Computer Science 2020-06-18 Yonglong Tian , Yue Wang , Dilip Krishnan , Joshua B. Tenenbaum , Phillip Isola

In this paper, we propose an attention-based end-to-end neural approach for small-footprint keyword spotting (KWS), which aims to simplify the pipelines of building a production-quality KWS system. Our model consists of an encoder and an…

Sound · Computer Science 2018-03-30 Changhao Shan , Junbo Zhang , Yujun Wang , Lei Xie

In this work, we address the problem of few-shot multi-class object counting with point-level annotations. The proposed technique leverages a class agnostic attention mechanism that sequentially attends to objects in the image and extracts…

Computer Vision and Pattern Recognition · Computer Science 2020-07-09 Negin Sokhandan , Pegah Kamousi , Alejandro Posada , Eniola Alese , Negar Rostamzadeh

Few-shot learning aims to recognize new categories using very few labeled samples. Although few-shot learning has witnessed promising development in recent years, most existing methods adopt an average operation to calculate prototypes,…

Computer Vision and Pattern Recognition · Computer Science 2021-08-26 Minglei Yuan , Wenhai Wang , Tao Wang , Chunhao Cai , Qian Xu , Tong Lu

Sound event detection is to infer the event by understanding the surrounding environmental sounds. Due to the scarcity of rare sound events, it becomes challenging for the well-trained detectors which have learned too much prior knowledge.…

Sound · Computer Science 2022-05-27 Chendong Zhao , Jianzong Wang , Leilai Li , Xiaoyang Qu , Jing Xiao

Best-performing speech models are trained on large amounts of data in the language they are meant to work for. However, most languages have sparse data, making training models challenging. This shortage of data is even more prevalent in…

Computation and Language · Computer Science 2024-10-08 David-Gabriel Ion , Răzvan-Alexandru Smădu , Dumitru-Clementin Cercel , Florin Pop , Mihaela-Claudia Cercel

In recent years, self-supervised learning has excelled for its capacity to learn robust feature representations from unlabelled data. Networks pretrained through self-supervision serve as effective feature extractors for downstream tasks,…

Sound · Computer Science 2024-02-15 Calum Heggan , Sam Budgett , Timothy Hospedales , Mehrdad Yaghoobi

Advances in deep learning have resulted in state-of-the-art performance for many audio classification tasks but, unlike humans, these systems traditionally require large amounts of data to make accurate predictions. Not every person or…

Audio and Speech Processing · Electrical Eng. & Systems 2020-12-04 Piper Wolters , Chris Careaga , Brian Hutchinson , Lauren Phillips

Few-shot classification is a challenging task which aims to formulate the ability of humans to learn concepts from limited prior data and has drawn considerable attention in machine learning. Recent progress in few-shot classification has…

Machine Learning · Computer Science 2020-04-14 Meiyu Huang , Xueshuang Xiang , Yao Xu

Learning with few samples is a major challenge for parameter-rich models like deep networks. In contrast, people learn complex new concepts even from very few examples, suggesting that the sample complexity of learning can often be reduced.…

Machine Learning · Computer Science 2019-06-11 Roman Visotsky , Yuval Atzmon , Gal Chechik

Few-shot classification consists of learning a predictive model that is able to effectively adapt to a new class, given only a few annotated samples. To solve this challenging problem, meta-learning has become a popular paradigm that…

Computer Vision and Pattern Recognition · Computer Science 2019-09-02 Nikita Dvornik , Cordelia Schmid , Julien Mairal

Few-shot learning is a type of classification through which predictions are made based on a limited number of samples for each class. This type of classification is sometimes referred to as a meta-learning problem, in which the model learns…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-02 Leah Chowenhill , Gaurav Satyanath , Shubhranshu Singh , Madhav Mahendra Wagh

In the area of multi-domain speech recognition, research in the past focused on hybrid acoustic models to build cross-domain and domain-invariant speech recognition systems. In this paper, we empirically examine the difference in behavior…

Audio and Speech Processing · Electrical Eng. & Systems 2020-03-10 Thai-Son Nguyen , Sebastian Stüker , Alex Waibel

On account of growing demands for personalization, the need for a so-called few-shot TTS system that clones speakers with only a few data is emerging. To address this issue, we propose Attentron, a few-shot TTS model that clones voices of…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-13 Seungwoo Choi , Seungju Han , Dongyoung Kim , Sungjoo Ha