中文
相关论文

相关论文: Domain Adaptation Method and Modality Gap Impact i…

200 篇论文

Self-supervised sound source localization is usually challenged by the modality inconsistency. In recent studies, contrastive learning based strategies have shown promising to establish such a consistent correspondence between audio and…

计算机视觉与模式识别 · 计算机科学 2023-08-10 Tianyu Liu , Peng Zhang , Wei Huang , Yufei Zha , Tao You , Yanning Zhang

Off-the-shelf models are widely used by computational social science researchers to measure properties of text, such as sentiment. However, without access to source data it is difficult to account for domain shift, which represents a threat…

计算与语言 · 计算机科学 2022-05-02 Junshen K. Chen , Dallas Card , Dan Jurafsky

Deep neural network (DNN)-based models for environmental sound classification are not robust against a domain to which training data do not belong, that is, out-of-distribution or unseen data. To utilize pretrained models for the unseen…

In classification tasks, the classification accuracy diminishes when the data is gathered in different domains. To address this problem, in this paper, we investigate several adversarial models for domain adaptation (DA) and their effect on…

声音 · 计算机科学 2023-09-08 Stanisław Kacprzak , Konrad Kowalczyk

Source-free domain adaptation aims to adapt a source-trained model to an unlabeled target domain without access to the source data. It has attracted growing attention in recent years, where existing approaches focus on self-training that…

计算机视觉与模式识别 · 计算机科学 2024-11-01 Idit Diamant , Amir Rosenfeld , Idan Achituve , Jacob Goldberger , Arnon Netzer

Detecting the presence of animal vocalisations in nature is essential to study animal populations and their behaviors. A recent development in the field is the introduction of the task known as few-shot bioacoustic sound event detection,…

音频与语音处理 · 电气工程与系统科学 2024-03-28 Jinhua Liang , Ines Nolasco , Burooj Ghani , Huy Phan , Emmanouil Benetos , Dan Stowell

Unsupervised domain adaptation leverages abundant labeled data from various source domains to generalize onto unlabeled target data. Prior research has primarily focused on learning domain-invariant features across the source and target…

计算与语言 · 计算机科学 2025-03-10 Jie He , Wendi Zhou , Xiang Lorraine Li , Jeff Z. Pan

Recent advancements in scene text spotting have focused on end-to-end methodologies that heavily rely on precise location annotations, which are often costly and labor-intensive to procure. In this study, we introduce an innovative approach…

计算机视觉与模式识别 · 计算机科学 2025-04-23 Jing Li , Bo Wang

Accurate real depth annotations are difficult to acquire, needing the use of special devices such as a LiDAR sensor. Self-supervised methods try to overcome this problem by processing video or stereo sequences, which may not always be…

计算机视觉与模式识别 · 计算机科学 2020-09-04 Adrian Lopez-Rodriguez , Krystian Mikolajczyk

Contrastive Language-Audio Pretraining (CLAP) models are widely used for audio understanding and support modality-agnostic condition swapping in many zero-shot applications. However, their performance is heavily affected by the modality gap…

声音 · 计算机科学 2026-05-29 Yonggang Zhu , Liting Gao , Aidong Men , Wenwu Wang

State-of-the-art anomalous sound detection (ASD) systems in domain-shifted conditions rely on projecting audio signals into an embedding space and using distance-based outlier detection to compute anomaly scores. One of the major…

音频与语音处理 · 电气工程与系统科学 2025-10-29 Kevin Wilkinghoff , Haici Yang , Janek Ebbers , François G. Germain , Gordon Wichern , Jonathan Le Roux

This paper introduces an ensemble of discriminators that improves the accuracy of a domain adaptation technique for the localization of multiple sound sources. Recently, deep neural networks have led to promising results for this task, yet…

音频与语音处理 · 电气工程与系统科学 2021-03-17 Guillaume Le Moing , Don Joven Agravante , Tadanobu Inoue , Jayakorn Vongkulbhisal , Asim Munawar , Ryuki Tachibana , Phongtharin Vinayavekhin

State-of-the-art approaches to infer dense depth measurements from images rely on CNNs trained end-to-end on a vast amount of data. However, these approaches suffer a drastic drop in accuracy when dealing with environments much different in…

计算机视觉与模式识别 · 计算机科学 2019-09-10 Alessio Tonioni , Matteo Poggi , Stefano Mattoccia , Luigi Di Stefano

A general problem in acoustic scene classification task is the mismatched conditions between training and testing data, which significantly reduces the performance of the developed methods on classification accuracy. As a countermeasure, we…

音频与语音处理 · 电气工程与系统科学 2018-08-20 Shayan Gharib , Konstantinos Drossos , Emre Çakir , Dmitriy Serdyuk , Tuomas Virtanen

Contrastive Language-Audio Pretraining (CLAP) is pre-trained to associate audio features with human language, making it a natural zero-shot classifier to recognize unseen sound categories. To adapt CLAP to downstream tasks, prior works…

音频与语音处理 · 电气工程与系统科学 2023-09-18 Yiming Li , Xiangdong Wang , Hong Liu

In this study, we propose a novel noise adaptive speech enhancement (SE) system, which employs a domain adversarial training (DAT) approach to tackle the issue of a noise type mismatch between the training and testing conditions. Such a…

声音 · 计算机科学 2019-07-02 Chien-Feng Liao , Yu Tsao , Hung-Yi Lee , Hsin-Min Wang

Anomaly detection has many important applications, such as monitoring industrial equipment. Despite recent advances in anomaly detection with deep-learning methods, it is unclear how existing solutions would perform under…

声音 · 计算机科学 2022-04-06 Bingqing Chen , Luca Bondi , Samarjit Das

Conventional end-to-end automatic speech recognition (ASR) systems rely on paired speech-text data for domain adaptation. Recent LLM-based ASR architectures connect a speech encoder to a large language model via a projection module,…

In spite of the recent success of Dialogue Act (DA) classification, the majority of prior works focus on text-based classification with oracle transcriptions, i.e. human transcriptions, instead of Automatic Speech Recognition (ASR)'s…

计算与语言 · 计算机科学 2018-10-18 Xuanli He , Quan Hung Tran , William Havard , Laurent Besacier , Ingrid Zukerman , Gholamreza Haffari

Automatic Music Transcription (AMT) is a vital technology in the field of music information processing. Despite recent enhancements in performance due to machine learning techniques, current methods typically attain high accuracy in domains…

声音 · 计算机科学 2024-07-04 Gakusei Sato , Taketo Akama