English
Related papers

Related papers: Domain Adaptation Method and Modality Gap Impact i…

200 papers

Self-supervised sound source localization is usually challenged by the modality inconsistency. In recent studies, contrastive learning based strategies have shown promising to establish such a consistent correspondence between audio and…

Computer Vision and Pattern Recognition · Computer Science 2023-08-10 Tianyu Liu , Peng Zhang , Wei Huang , Yufei Zha , Tao You , Yanning Zhang

Off-the-shelf models are widely used by computational social science researchers to measure properties of text, such as sentiment. However, without access to source data it is difficult to account for domain shift, which represents a threat…

Computation and Language · Computer Science 2022-05-02 Junshen K. Chen , Dallas Card , Dan Jurafsky

Deep neural network (DNN)-based models for environmental sound classification are not robust against a domain to which training data do not belong, that is, out-of-distribution or unseen data. To utilize pretrained models for the unseen…

In classification tasks, the classification accuracy diminishes when the data is gathered in different domains. To address this problem, in this paper, we investigate several adversarial models for domain adaptation (DA) and their effect on…

Sound · Computer Science 2023-09-08 Stanisław Kacprzak , Konrad Kowalczyk

Source-free domain adaptation aims to adapt a source-trained model to an unlabeled target domain without access to the source data. It has attracted growing attention in recent years, where existing approaches focus on self-training that…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Idit Diamant , Amir Rosenfeld , Idan Achituve , Jacob Goldberger , Arnon Netzer

Detecting the presence of animal vocalisations in nature is essential to study animal populations and their behaviors. A recent development in the field is the introduction of the task known as few-shot bioacoustic sound event detection,…

Audio and Speech Processing · Electrical Eng. & Systems 2024-03-28 Jinhua Liang , Ines Nolasco , Burooj Ghani , Huy Phan , Emmanouil Benetos , Dan Stowell

Unsupervised domain adaptation leverages abundant labeled data from various source domains to generalize onto unlabeled target data. Prior research has primarily focused on learning domain-invariant features across the source and target…

Computation and Language · Computer Science 2025-03-10 Jie He , Wendi Zhou , Xiang Lorraine Li , Jeff Z. Pan

Recent advancements in scene text spotting have focused on end-to-end methodologies that heavily rely on precise location annotations, which are often costly and labor-intensive to procure. In this study, we introduce an innovative approach…

Computer Vision and Pattern Recognition · Computer Science 2025-04-23 Jing Li , Bo Wang

Accurate real depth annotations are difficult to acquire, needing the use of special devices such as a LiDAR sensor. Self-supervised methods try to overcome this problem by processing video or stereo sequences, which may not always be…

Computer Vision and Pattern Recognition · Computer Science 2020-09-04 Adrian Lopez-Rodriguez , Krystian Mikolajczyk

Contrastive Language-Audio Pretraining (CLAP) models are widely used for audio understanding and support modality-agnostic condition swapping in many zero-shot applications. However, their performance is heavily affected by the modality gap…

Sound · Computer Science 2026-05-29 Yonggang Zhu , Liting Gao , Aidong Men , Wenwu Wang

State-of-the-art anomalous sound detection (ASD) systems in domain-shifted conditions rely on projecting audio signals into an embedding space and using distance-based outlier detection to compute anomaly scores. One of the major…

Audio and Speech Processing · Electrical Eng. & Systems 2025-10-29 Kevin Wilkinghoff , Haici Yang , Janek Ebbers , François G. Germain , Gordon Wichern , Jonathan Le Roux

This paper introduces an ensemble of discriminators that improves the accuracy of a domain adaptation technique for the localization of multiple sound sources. Recently, deep neural networks have led to promising results for this task, yet…

Audio and Speech Processing · Electrical Eng. & Systems 2021-03-17 Guillaume Le Moing , Don Joven Agravante , Tadanobu Inoue , Jayakorn Vongkulbhisal , Asim Munawar , Ryuki Tachibana , Phongtharin Vinayavekhin

State-of-the-art approaches to infer dense depth measurements from images rely on CNNs trained end-to-end on a vast amount of data. However, these approaches suffer a drastic drop in accuracy when dealing with environments much different in…

Computer Vision and Pattern Recognition · Computer Science 2019-09-10 Alessio Tonioni , Matteo Poggi , Stefano Mattoccia , Luigi Di Stefano

A general problem in acoustic scene classification task is the mismatched conditions between training and testing data, which significantly reduces the performance of the developed methods on classification accuracy. As a countermeasure, we…

Audio and Speech Processing · Electrical Eng. & Systems 2018-08-20 Shayan Gharib , Konstantinos Drossos , Emre Çakir , Dmitriy Serdyuk , Tuomas Virtanen

Contrastive Language-Audio Pretraining (CLAP) is pre-trained to associate audio features with human language, making it a natural zero-shot classifier to recognize unseen sound categories. To adapt CLAP to downstream tasks, prior works…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-18 Yiming Li , Xiangdong Wang , Hong Liu

In this study, we propose a novel noise adaptive speech enhancement (SE) system, which employs a domain adversarial training (DAT) approach to tackle the issue of a noise type mismatch between the training and testing conditions. Such a…

Sound · Computer Science 2019-07-02 Chien-Feng Liao , Yu Tsao , Hung-Yi Lee , Hsin-Min Wang

Anomaly detection has many important applications, such as monitoring industrial equipment. Despite recent advances in anomaly detection with deep-learning methods, it is unclear how existing solutions would perform under…

Sound · Computer Science 2022-04-06 Bingqing Chen , Luca Bondi , Samarjit Das

Conventional end-to-end automatic speech recognition (ASR) systems rely on paired speech-text data for domain adaptation. Recent LLM-based ASR architectures connect a speech encoder to a large language model via a projection module,…

In spite of the recent success of Dialogue Act (DA) classification, the majority of prior works focus on text-based classification with oracle transcriptions, i.e. human transcriptions, instead of Automatic Speech Recognition (ASR)'s…

Computation and Language · Computer Science 2018-10-18 Xuanli He , Quan Hung Tran , William Havard , Laurent Besacier , Ingrid Zukerman , Gholamreza Haffari

Automatic Music Transcription (AMT) is a vital technology in the field of music information processing. Despite recent enhancements in performance due to machine learning techniques, current methods typically attain high accuracy in domains…

Sound · Computer Science 2024-07-04 Gakusei Sato , Taketo Akama