中文
相关论文

相关论文: Using Self-Supervised Feature Extractors with Atte…

200 篇论文

The issue in respiratory sound classification has attained good attention from the clinical scientists and medical researcher's group in the last year to diagnosing COVID-19 disease. To date, various models of Artificial Intelligence (AI)…

声音 · 计算机科学 2021-12-15 Kranthi Kumar Lella , Alphonse Pja

Disease detection from smartphone data represents an open research challenge in mobile health (m-health) systems. COVID-19 and its respiratory symptoms are an important case study in this area and their early detection is a potential real…

机器学习 · 计算机科学 2023-07-07 Mattia Giovanni Campana , Franca Delmastro , Elena Pagani

A wide range of respiratory diseases, such as cold and flu, asthma, and COVID-19, affect people's daily lives worldwide. In medical practice, respiratory sounds are widely used in medical services to diagnose various respiratory illnesses…

声音 · 计算机科学 2024-06-21 Asmaa Shati , Ghulam Mubashar Hassan , Amitava Datta

The Transformer-based models with the multi-head self-attention mechanism are widely used in natural language processing, and provide state-of-the-art results. While the pre-trained language backbones are shown to implicitly capture certain…

计算与语言 · 计算机科学 2023-12-18 Zhengyuan Liu , Nancy F. Chen

Smartphones and wearable devices, along with Artificial Intelligence, can represent a game-changer in the pandemic control, by implementing low-cost and pervasive solutions to recognize the development of new diseases at their early stages…

声音 · 计算机科学 2022-05-17 Mattia Giovanni Campana , Andrea Rovati , Franca Delmastro , Elena Pagani

Self-supervised features are typically used in place of filter-bank features in speaker verification models. However, these models were originally designed to ingest filter-bank features as inputs, and thus, training them on top of…

One of the most important parts of an end-to-end speaker verification system is the speaker embedding generation. In our previous paper, we reported that shortcut connections-based multi-layer aggregation improves the representational power…

音频与语音处理 · 电气工程与系统科学 2020-07-29 Soonshin Seo , Ji-Hwan Kim

Deep Convolutional features extracted from a comprehensive labeled dataset, contain substantial representations which could be effectively used in a new domain. Despite the fact that generic features achieved good results in many visual…

计算机视觉与模式识别 · 计算机科学 2018-05-06 Qun Liu , Supratik Mukhopadhyay

Convolutional neural network (CNN) modules are widely being used to build high-end speech enhancement neural models. However, the feature extraction power of vanilla CNN modules has been limited by the dimensionality constraint of the…

音频与语音处理 · 电气工程与系统科学 2021-06-07 Muhammed PV Shifas , Santelli Claudio , Vassilis Tsiaras , Yannis Stylianou

The recently proposed self-attentive pooling (SAP) has shown good performance in several speaker recognition systems. In SAP systems, the context vector is trained end-to-end together with the feature extractor, where the role of context…

声音 · 计算机科学 2020-12-04 Seong Min Kye , Joon Son Chung , Hoirin Kim

In this paper, we propose a new differentiable neural network alignment mechanism for text-dependent speaker verification which uses alignment models to produce a supervector representation of an utterance. Unlike previous works with…

声音 · 计算机科学 2018-12-27 Victoria Mingote , Antonio Miguel , Alfonso Ortega , Eduardo Lleida

Background: The COVID-19 pandemic has highlighted the need for robust diagnostic tools capable of detecting the disease from diverse and evolving data sources. Machine learning models, especially convolutional neural networks (CNNs), have…

We investigate the potential benefit of incorporating dictionary information into a neural network architecture for natural language processing. In particular, we make use of this architecture to extract several concepts related to COVID-19…

计算与语言 · 计算机科学 2023-09-06 Abul Hasan , Mark Levene , David Weston

The computing power of mobile devices limits the end-user applications in terms of storage size, processing, memory and energy consumption. These limitations motivate researchers for the design of more efficient deep models. On the other…

音频与语音处理 · 电气工程与系统科学 2020-08-05 Pooyan Safari , Miquel India , Javier Hernando

In this work, we focus on the detection of depression through speech analysis. Previous research has widely explored features extracted from pre-trained models (PTMs) primarily trained for paralinguistic tasks. Although these features have…

音频与语音处理 · 电气工程与系统科学 2024-06-12 Orchid Chetia Phukan , Sarthak Jain , Shubham Singh , Muskaan Singh , Arun Balaji Buduru , Rajesh Sharma

Question retrieval is a crucial subtask for community question answering. Previous research focus on supervised models which depend heavily on training data and manual feature engineering. In this paper, we propose a novel unsupervised…

计算与语言 · 计算机科学 2018-03-12 Minghua Zhang , Yunfang Wu

In speaker verification, the extraction of voice representations is mainly based on the Residual Neural Network (ResNet) architecture. ResNet is built upon convolution layers which learn filters to capture local spatial patterns along all…

音频与语音处理 · 电气工程与系统科学 2021-09-14 Mickael Rouvier , Pierre-Michel Bousquet

In this paper, we propose a novel way of addressing text-dependent automatic speaker verification (TD-ASV) by using a shared-encoder with task-specific decoders. An autoregressive predictive coding (APC) encoder is pre-trained in an…

音频与语音处理 · 电气工程与系统科学 2020-08-11 Vijay Ravi , Ruchao Fan , Amber Afshan , Huanhua Lu , Abeer Alwan

The emergence of self-supervised representation (i.e., wav2vec 2.0) allows speaker-recognition approaches to process spoken signals through foundation models built on speech data. Nevertheless, effective fusion on the representation…

声音 · 计算机科学 2024-02-27 Zirui Ge , Xinzhou Xu , Haiyan Guo , Tingting Wang , Zhen Yang

End-to-end models are favored in automatic speech recognition (ASR) because of their simplified system structure and superior performance. Among these models, Transformer and Conformer have achieved state-of-the-art recognition accuracy in…

声音 · 计算机科学 2021-06-18 Xiong Wang , Sining Sun , Lei Xie , Long Ma