English
Related papers

Related papers: Improving Domain Generalization for Sound Classifi…

200 papers

Domain shift is a prominent problem in Deep Learning, causing a model pre-trained on a source dataset to suffer significant performance degradation on test datasets. This research aims to address the issue of audio classification under…

Machine Learning · Computer Science 2025-07-22 Weichuang Shao , Iman Yi Liao , Tomas Henrique Bode Maul , Tissa Chandesa

In this work, we explore the usage of the Frequency Transformation for reducing the domain shift between the source and target domain (e.g., synthetic image and real image respectively) towards solving the Domain Adaptation task. Most of…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Vikash Kumar , Himanshu Patil , Rohit Lal , Anirban Chakraborty

Driven by the continuous development of models such as Multi-Layer Perceptron, Convolutional Neural Network (CNN), and Transformer, deep learning has made breakthrough progress in fields such as computer vision and natural language…

Computer Vision and Pattern Recognition · Computer Science 2026-03-05 Shuang Liu , Lina Zhao , Tian Wang , Huaqing Wang

State of the art (SOTA) few-shot learning (FSL) methods suffer significant performance drop in the presence of domain differences between source and target datasets. The strong discrimination ability on the source dataset does not…

Computer Vision and Pattern Recognition · Computer Science 2021-09-24 Hanwen Liang , Qiong Zhang , Peng Dai , Juwei Lu

Detectors often suffer from performance drop due to domain gap between training and testing data. Recent methods explore diffusion models applied to domain generalization (DG) and adaptation (DA) tasks, but still struggle with large…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Boyong He , Yuxiang Ji , Zhuoyue Tan , Liaoni Wu

Domain generalization aims to learn a model from multiple training domains and generalize it to unseen test domains. Recent theory has shown that seeking the deep models, whose parameters lie in the flat minima of the loss landscape, can…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Aodi Li , Liansheng Zhuang , Xiao Long , Minghong Yao , Shafei Wang

The state-of-the-art automotive radars employ multidimensional discrete Fourier transforms (DFT) in order to estimate various target parameters. The DFT is implemented using the fast Fourier transform (FFT), at sample and computational…

Signal Processing · Electrical Eng. & Systems 2018-01-16 Shaogang Wang , Vishal M. Patel , Athina Petropulu

In this paper, we investigate whether we could use pruning as a reliable method to boost the generalization ability of the model. We found that existing pruning method like L2 can already offer small improvement on the target domain…

Machine Learning · Computer Science 2023-06-27 Xinglong Sun

Recently, many datasets have been proposed to test the systematic generalization ability of neural networks. The companion baseline Transformers, typically trained with default hyper-parameters from standard tasks, are shown to fail…

Machine Learning · Computer Science 2022-02-15 Róbert Csordás , Kazuki Irie , Jürgen Schmidhuber

Transformers have become central to recent advances in audio classification. However, training an audio spectrogram transformer, e.g. AST, from scratch can be resource and time-intensive. Furthermore, the complexity of transformers heavily…

Sound · Computer Science 2024-01-17 Jiu Feng , Mehmet Hamza Erol , Joon Son Chung , Arda Senocak

Semantic segmentation models trained on annotated data fail to generalize well when the input data distribution changes over extended time period, leading to requiring re-training to maintain performance. Classic Unsupervised domain…

Computer Vision and Pattern Recognition · Computer Science 2024-01-03 Serban Stan , Mohammad Rostami

Test-Time Adaptation (TTA) is essential for enabling deep learning models to handle real-world data distribution shifts. However, current approaches face significant limitations: backpropagation-based methods are not suitable for low-end…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Xingyu Wang , Tao Wang

In this work we propose a novel token-based training strategy that improves Transformer-Transducer (T-T) based speaker change detection (SCD) performance. The conventional T-T based SCD model loss optimizes all output tokens equally. Due to…

Audio and Speech Processing · Electrical Eng. & Systems 2022-12-06 Guanlong Zhao , Quan Wang , Han Lu , Yiling Huang , Ignacio Lopez Moreno

We investigate supervised learning strategies that improve the training of neural network audio classifiers on small annotated collections. In particular, we study whether (i) a naive regularization of the solution space, (ii) prototypical…

Sound · Computer Science 2018-11-07 Jordi Pons , Joan Serrà , Xavier Serra

Audio production style transfer is the task of processing an input to impart stylistic elements from a reference recording. Existing approaches often train a neural network to estimate control parameters for a set of audio effects. However,…

We propose a novel regularizer for supervised learning called Conditioning on Noisy Targets (CNT). This approach consists in conditioning the model on a noisy version of the target(s) (e.g., actions in imitation learning or labels in…

Machine Learning · Computer Science 2022-10-28 Alexia Jolicoeur-Martineau , Alex Lamb , Vikas Verma , Aniket Didolkar

In this paper, we consider a regularization strategy for the factorization method when there is noise added to the data operator. The factorization method is a qualitative method used in shape reconstruction problems. These methods are…

Analysis of PDEs · Mathematics 2023-04-05 Isaac Harris

In recent years, Sound AI is being increasingly used to predict machine failures. By attaching a microphone to the machine of interest, one can get real time data on machine behavior from the field. Traditionally, Convolutional Neural Net…

Sound · Computer Science 2026-04-15 Kiran Voderhobli Holla

The success of denoising diffusion models raises important questions regarding their generalisation behaviour, particularly in high-dimensional settings. Notably, it has been shown that when training and sampling are performed perfectly,…

Machine Learning · Statistics 2025-07-08 Tyler Farghly , Patrick Rebeschini , George Deligiannidis , Arnaud Doucet

Inverse optimization (IO) seeks to infer the parameters of a decision-maker's objective from observed context--action data. We study noiseless IO, where demonstrations are generated by a ground-truth objective. We provide a high-probability…

Machine Learning · Statistics 2026-05-12 Pouria Fatemi , Hoomaan Maskan , Suvrit Sra , Peyman Mohajerin Esfahani