English
Related papers

Related papers: Adaptable Non-parametric Approach for Speech-based…

200 papers

Self-supervised learning (SSL) has recently shown remarkable results in closing the gap between supervised and unsupervised learning. The idea is to learn robust features that are invariant to distortions of the input data. Despite its…

Sound · Computer Science 2023-03-08 Bac Nguyen , Stefan Uhlich , Fabien Cardinaux

Early detection of exacerbations in asthma and chronic obstructive pulmonary disease (COPD) is important for timely intervention. Speech has emerged as a promising tool for continuous, non-invasive respiratory disease monitoring. However,…

Sound · Computer Science 2026-05-19 Yuyang Yan , Sami O. Simons , Visara Urovi

In this paper, we propose a new Self-Supervised Learning (SSL) algorithm called data2vec-aqc, for speech representation learning from unlabeled speech data. Our goal is to improve SSL for speech in domains where both unlabeled and labeled…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-16 Vasista Sai Lodagala , Sreyan Ghosh , S. Umesh

Self-supervised learning (SSL) has emerged as a key technique for training networks that can generalize well to diverse tasks without task-specific supervision. This property makes SSL desirable for computational pathology, the study of…

Computer Vision and Pattern Recognition · Computer Science 2024-05-06 Eric Zimmermann , Neil Tenenholtz , James Hall , George Shaikovski , Michal Zelechowski , Adam Casson , Fausto Milletari , Julian Viret , Eugene Vorontsov , Siqi Liu , Kristen Severson

In this paper, we propose a privacy-preserving method with a secret key for convolutional neural network (CNN)-based speech classification tasks. Recently, many methods related to privacy preservation have been developed in image…

Audio and Speech Processing · Electrical Eng. & Systems 2023-10-09 Shoko Niwa , Sayaka Shiota , Hitoshi Kiya

State-of-the-art speaker recognition relays on models that need a large amount of training data. This models are successful in tasks like NIST SRE because there is sufficient data available. However, in real applications, we usually do not…

Machine Learning · Statistics 2015-11-25 Jesús Villalba

We propose an adaptive training scheme for unsupervised medical image registration. Existing methods rely on image reconstruction as the primary supervision signal. However, nuisance variables (e.g. noise and covisibility), violation of the…

Image and Video Processing · Electrical Eng. & Systems 2024-07-19 Xiaoran Zhang , John C. Stendahl , Lawrence Staib , Albert J. Sinusas , Alex Wong , James S. Duncan

Incremental learning is one paradigm to enable model building and updating at scale with streaming data. For end-to-end automatic speech recognition (ASR) tasks, the absence of human annotated labels along with the need for privacy…

Whispering is a distinct form of speech known for its soft, breathy, and hushed characteristics, often used for private communication. The acoustic characteristics of whispered speech differ substantially from normally phonated speech and…

Audio and Speech Processing · Electrical Eng. & Systems 2024-02-08 Zhaofeng Lin , Tanvina Patel , Odette Scharenborg

Semi-supervised learning (SSL) has been widely explored in recent years, and it is an effective way of leveraging unlabeled data to reduce the reliance on labeled data. In this work, we adjust neural processes (NPs) to the semi-supervised…

Computer Vision and Pattern Recognition · Computer Science 2023-06-27 Jianfeng Wang , Xiaolin Hu , Thomas Lukasiewicz

Semi-supervised learning (SSL) can reduce the need for large labelled datasets by incorporating unlabelled data into the training. This is particularly interesting for semantic segmentation, where labelling data is very costly and…

Computer Vision and Pattern Recognition · Computer Science 2022-10-20 Sebastian Scherer , Robin Schön , Rainer Lienhart

Spoken Language Models (SLMs) have emerged as a promising paradigm for speech synthesis by bypassing explicit grapheme-to-phoneme pipelines. However, their effectiveness in low-resource languages remains fundamentally limited by the…

Computation and Language · Computer Science 2026-05-28 Yizhong Geng , Yanliang Li , Jinghan Yang , Tianhan Jiang , Boxun An , Ya Li , Xiaoyu Shen

Data augmentation is widely used for machine learning; however, an effective method to apply data augmentation has not been established even though it includes several factors that should be tuned carefully. One such factor is sample…

Machine Learning · Computer Science 2020-10-30 Tomoumi Takase , Ryo Karakida , Hideki Asoh

Deep learning models trained in a supervised setting have revolutionized audio and speech processing. However, their performance inherently depends on the quantity of human-annotated data, making them costly to scale and prone to poor…

Audio and Speech Processing · Electrical Eng. & Systems 2026-02-12 Theo Lepage , Reda Dehak

In this work, we study the features extracted by English self-supervised learning (SSL) models in cross-lingual contexts and propose a new metric to predict the quality of feature representations. Using automatic speech recognition (ASR) as…

Computation and Language · Computer Science 2023-11-28 Shuyue Stella Li , Beining Xu , Xiangyu Zhang , Hexin Liu , Wenhan Chao , Leibny Paola Garcia

Retrieval-based language models (LMs) have demonstrated improved interpretability, factuality, and adaptability compared to their parametric counterparts, by incorporating retrieved text from external datastores. While it is well known that…

Computation and Language · Computer Science 2023-05-25 Yangsibo Huang , Samyak Gupta , Zexuan Zhong , Kai Li , Danqi Chen

The number and dynamic nature of web and mobile applications presents significant challenges for assessing their compliance with data protection laws. In this context, symbolic and statistical Natural Language Processing (NLP) techniques…

Computation and Language · Computer Science 2025-12-22 David Rodriguez , Ian Yang , Jose M. Del Alamo , Norman Sadeh

It is well known that recognizers personalized to each user are much more effective than user-independent recognizers. With the popularity of smartphones today, although it is not difficult to collect a large set of audio data for each…

Sound · Computer Science 2017-06-27 Cheng-Kuan Wei , Cheng-Tao Chung , Hung-Yi Lee , Lin-Shan Lee

Objective: To enable privacy-preserving learning of high quality generative and discriminative machine learning models from distributed electronic health records. Methods and Results: We describe general and scalable strategy to build…

Cryptography and Security · Computer Science 2018-06-19 Marina Blanton , Ah Reum Kang , Subhadeep Karan , Jaroslaw Zola

Self-supervised learning (SSL) has been able to leverage unlabeled data to boost the performance of automatic speech recognition (ASR) models when we have access to only a small amount of transcribed speech data. However, this raises the…

Audio and Speech Processing · Electrical Eng. & Systems 2022-12-06 Reem Gody , David Harwath