English
Related papers

Related papers: Unsupervised neural adaptation model based on opti…

200 papers

While Self-supervised Learning (SSL) has significantly improved Spoken Language Identification (LID), existing models often struggle to consistently classify dialects and accents of the same language as a unified class. To address this…

Computation and Language · Computer Science 2025-08-26 Qingzheng Wang , Hye-jin Shim , Jiancheng Sun , Shinji Watanabe

The problem of estimating the probability distribution of labels has been widely studied as a label distribution learning (LDL) problem, whose applications include age estimation, emotion analysis, and semantic segmentation. We propose a…

Machine Learning · Computer Science 2021-03-02 Ayato Toyokuni , Sho Yokoi , Hisashi Kashima , Makoto Yamada

Semi-supervised learning methods have shown promising results in solving many practical problems when only a few labels are available. The existing methods assume that the class distributions of labeled and unlabeled data are equal;…

Machine Learning · Computer Science 2024-08-06 Min Gu Kwak , Hyungu Kahng , Seoung Bum Kim

We evaluate the out-of-distribution (OOD) detection performance of self-supervised learning (SSL) techniques with a new evaluation framework. Unlike the previous evaluation methods, the proposed framework adjusts the distance of OOD samples…

Machine Learning · Computer Science 2021-10-19 Jeonghoon Park , Kyungmin Jo , Daehoon Gwak , Jimin Hong , Jaegul Choo , Edward Choi

The performance of machine learning algorithms is known to be negatively affected by possible mismatches between training (source) and test (target) data distributions. In fact, this problem emerges whenever an acoustic scene classification…

Audio and Speech Processing · Electrical Eng. & Systems 2020-05-04 Alessandro Ilic Mezza , Emanuël A. P. Habets , Meinard Müller , Augusto Sarti

Optimal transport is widely used to learn distributions, enforce distributional constraints, and model uncertainty. In applications, transport losses are often computed from samples through tractable representations, such as one-dimensional…

Optimization and Control · Mathematics 2026-05-28 Tam Le

Semi-supervised learning (SSL) is a popular setting aiming to effectively utilize unlabelled data to improve model performance in downstream natural language processing (NLP) tasks. Currently, there are two popular approaches to make use of…

Computation and Language · Computer Science 2023-05-23 Zhengxiang Shi , Francesco Tonolini , Nikolaos Aletras , Emine Yilmaz , Gabriella Kazai , Yunlong Jiao

Large pre-trained vision-language models (VLMs), such as CLIP, have shown unprecedented zero-shot performance across a wide range of tasks. Nevertheless, these models may be unreliable under distributional shifts, as their performance is…

Computer Vision and Pattern Recognition · Computer Science 2026-01-05 Shambhavi Mishra , Julio Silva-Rodriguez , Ismail Ben Ayed , Marco Pedersoli , Jose Dolz

Hyperspectral images capture vast amounts of high-dimensional spectral information about a scene, making labeling an intensive task that is resistant to out-of-the-box statistical methods. Unsupervised learning of clusters allows for…

Computer Vision and Pattern Recognition · Computer Science 2026-03-12 Joshua Lentz , Nicholas Karris , Alex Cloninger , James M. Murphy

We propose a novel approach for semi-supervised learning (SSL) designed to overcome distribution shifts between training and real-world data arising in the keyword spotting (KWS) task. Shifts from training data distribution are a key…

Sound · Computer Science 2022-07-15 Sree Hari Krishnan Parthasarathi , Lu Zeng , Christin Jose , Joseph Wang

Recently, supervised speech separation has made great progress. However, limited by the nature of supervised training, most existing separation methods require ground-truth sources and are trained on synthetic datasets. This ground-truth…

Audio and Speech Processing · Electrical Eng. & Systems 2022-08-09 Jiangyu Han , Yanhua Long

Domain adaptation (DA) aims to enable a learning model trained from a source domain to generalize well on a target domain, despite the mismatch of data distributions between the two domains. State-of-the-art DA methods have so far focused…

Computer Vision and Pattern Recognition · Computer Science 2021-01-13 Lingkun Luo , Liming Chen , Shiqiang Hu

Self-supervised learning (SSL) has transformed speech processing, yet its reliance on massive pre-training datasets remains a bottleneck. While robustness is often attributed to scale and diversity, the role of the data distribution is less…

Sound · Computer Science 2026-04-24 Ryan Whetten , Titouan Parcollet , Marco Dinarelli , Yannick Estève

Deep neural networks have been widely used in communication signal recognition and achieved remarkable performance, but this superiority typically depends on using massive examples for supervised learning, whereas training a deep neural…

Signal Processing · Electrical Eng. & Systems 2023-11-15 Weidong Wang , Hongshu Liao , Lu Gan

In recent years, the machine learning community has increasingly embraced the optimal transport (OT) framework for modeling distributional relationships. In this work, we introduce a sample-based neural solver for computing the Wasserstein…

Machine Learning · Computer Science 2026-02-26 Hailiang Liu , Yan-Han Chen

Modeling code-switched speech is an important problem in automatic speech recognition (ASR). Labeled code-switched data are rare, so monolingual data are often used to model code-switched speech. These monolingual data may be more closely…

Computation and Language · Computer Science 2021-06-16 Andrew Slottje , Shannon Wotherspoon , William Hartmann , Matthew Snover , Owen Kimball

Theoretical works on supervised transfer learning (STL) -- where the learner has access to labeled samples from both source and target distributions -- have for the most part focused on statistical aspects of the problem, while efficient…

Machine Learning · Statistics 2025-07-08 Yuyang Deng , Samory Kpotufe

In open-set semi-supervised learning (OSSL), we consider unlabeled datasets that may contain unknown classes. Existing OSSL methods often use the softmax confidence for classifying data as in-distribution (ID) or out-of-distribution (OOD).…

Machine Learning · Computer Science 2026-01-26 Erik Wallin , Lennart Svensson , Fredrik Kahl , Lars Hammarstrand

We propose a simple neural network model to deal with the domain adaptation problem in object recognition. Our model incorporates the Maximum Mean Discrepancy (MMD) measure as a regularization in the supervised learning to reduce the…

Computer Vision and Pattern Recognition · Computer Science 2016-07-28 Muhammad Ghifary , W. Bastiaan Kleijn , Mengjie Zhang

Recent advancement of large language models (LLMs) has led to significant breakthroughs across various tasks, laying the foundation for the development of LLM-based speech translation systems. Existing methods primarily focus on aligning…

Computation and Language · Computer Science 2025-03-14 Henglyu Liu , Andong Chen , Kehai Chen , Xuefeng Bai , Meizhi Zhong , Yuan Qiu , Min Zhang