English
Related papers

Related papers: Perch 2.0 transfers 'whale' to underwater tasks

200 papers

Deep learning based speech denoising still suffers from the challenge of improving perceptual quality of enhanced signals. We introduce a generalized framework called Perceptual Ensemble Regularization Loss (PERL) built on the idea of…

Audio and Speech Processing · Electrical Eng. & Systems 2020-10-23 Saurabh Kataria , Jesús Villalba , Najim Dehak

It is easier to hear birds than see them, however, they still play an essential role in nature and they are excellent indicators of deteriorating environmental quality and pollution. Recent advances in Machine Learning and Convolutional…

Sound · Computer Science 2021-07-13 Marcos V. Conde , Kumar Shubham , Prateek Agnihotri , Nitin D. Movva , Szilard Bessenyei

Reliably monitoring and recognizing maritime vessels based on acoustic signatures is complicated by the variability of different recording scenarios. A robust classification framework must be able to generalize across diverse acoustic…

Sound · Computer Science 2025-06-02 Jonas Elsborg , Tejs Vegge , Arghya Bhowmik

Wav2vec 2.0 is a recently proposed self-supervised framework for speech representation learning. It follows a two-stage training process of pre-training and fine-tuning, and performs well in speech recognition tasks especially ultra-low…

Sound · Computer Science 2021-01-15 Zhiyun Fan , Meng Li , Shiyu Zhou , Bo Xu

The \emph{beep model} is a very weak communications model in which devices in a network can communicate only via beeps and silence. As a result of its weak assumptions, it has broad applicability to many different implementations of…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-03-19 Artur Czumaj , Peter Davies

While the animal bioacoustics community at large is collecting huge amounts of acoustic data at an unprecedented pace, processing these data is problematic. Currently in bioacoustics, there is no effective way to achieve high performance…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-05-06 Peter J. Dugan , Christopher W. Clark , Yann André LeCun , Sofie M. Van Parijs

Few-shot crosslingual transfer has been shown to outperform its zero-shot counterpart with pretrained encoders like multilingual BERT. Despite its growing popularity, little to no attention has been paid to standardizing and analyzing the…

Computation and Language · Computer Science 2021-06-03 Mengjie Zhao , Yi Zhu , Ehsan Shareghi , Ivan Vulić , Roi Reichart , Anna Korhonen , Hinrich Schütze

This paper introduces a new training strategy to improve speech dereverberation systems using minimal acoustic information and reverberant (wet) speech. Most existing algorithms rely on paired dry/wet data, which is difficult to obtain, or…

Audio and Speech Processing · Electrical Eng. & Systems 2025-02-12 Louis Bahrman , Mathieu Fontaine , Gael Richard

With the upcoming commensal surveys for Fast Radio Bursts (FRBs), and their high candidate rate, usage of machine learning algorithms for candidate classification is a necessity. Such algorithms will also play a pivotal role in sending…

Instrumentation and Methods for Astrophysics · Physics 2020-06-26 Devansh Agarwal , Kshitij Aggarwal , Sarah Burke-Spolaor , Duncan R. Lorimer , Nathaniel Garver-Daniels

Over the past few years, audio classification task on large-scale dataset such as AudioSet has been an important research area. Several deeper Convolution-based Neural networks have shown compelling performance notably Vggish, YAMNet, and…

Sound · Computer Science 2023-05-23 Shwetank Choudhary , CR Karthik , Punuru Sri Lakshmi , Sumit Kumar

Although few-shot learning has attracted much attention from the fields of image and audio classification, few efforts have been made on few-shot speaker identification. In the task of few-shot learning, overfitting is a tough problem…

Audio and Speech Processing · Electrical Eng. & Systems 2022-04-26 Yanxiong Li , Wucheng Wang , Hao Chen , Wenchang Cao , Wei Li , Qianhua He

Language-audio joint representation learning frameworks typically depend on deterministic embeddings, assuming a one-to-one correspondence between audio and text. In real-world settings, however, the language-audio relationship is…

Audio and Speech Processing · Electrical Eng. & Systems 2025-10-22 Toranosuke Manabe , Yuchi Ishikawa , Hokuto Munakata , Tatsuya Komatsu

We introduce a novel method for multilingual transfer that utilizes deep contextual embeddings, pretrained in an unsupervised fashion. While contextual embeddings have been shown to yield richer representations of meaning compared to their…

Computation and Language · Computer Science 2019-04-05 Tal Schuster , Ori Ram , Regina Barzilay , Amir Globerson

Psychoacoustical so-called "timbre spaces" map perceptual similarity ratings of instrument sounds onto low-dimensional embeddings via multidimensional scaling, but suffer from scalability issues and are incapable of generalization. Recent…

Sound · Computer Science 2025-07-11 Haokun Tian , Stefan Lattner , Charalampos Saitis

Speech embeddings are fixed-size acoustic representations of variable-length speech sequences. They are increasingly used for a variety of tasks ranging from information retrieval to unsupervised term discovery and speech segmentation.…

Audio and Speech Processing · Electrical Eng. & Systems 2020-11-09 Robin Algayres , Mohamed Salah Zaiem , Benoit Sagot , Emmanuel Dupoux

We propose a novel transfer learning method for speech emotion recognition allowing us to obtain promising results when only few training data is available. With as low as 125 examples per emotion class, we were able to reach a higher…

Machine Learning · Computer Science 2020-11-12 Jonathan Boigne , Biman Liyanage , Ted Östrem

Microphone array techniques can improve the acoustic sensing performance on drones, compared to the use of a single microphone. However, multichannel sound acquisition systems are not available in current commercial drone platforms. To…

Audio and Speech Processing · Electrical Eng. & Systems 2021-01-19 Michael Clayton , Lin Wang , Andrew McPherson , Andrea Cavallaro

In this paper, we explore the untapped potential of Whisper, a well-established automatic speech recognition (ASR) foundation model, in the context of L2 spoken language assessment (SLA). Unlike prior studies that extrinsically analyze…

Computation and Language · Computer Science 2026-01-27 Fu-An Chao , Bi-Cheng Yan , Berlin Chen

Automatic recognition of insect sound could help us understand changing biodiversity trends around the world -- but insect sounds are challenging to recognize even for deep learning. We present a new dataset comprised of 26399 audio files,…

Sound · Computer Science 2025-03-20 Marius Faiß , Burooj Ghani , Dan Stowell

In contemporary deep learning, a prevalent and effective workflow for solving low-data problems is adapting powerful pre-trained foundation models (FMs) to new tasks via parameter-efficient fine-tuning (PEFT). However, while empirically…

Machine Learning · Computer Science 2025-05-29 Fady Rezk , Royson Lee , Henry Gouk , Timothy Hospedales , Minyoung Kim