English
Related papers

Related papers: COALA: Co-Aligned Autoencoders for Learning Semant…

200 papers

Music classification has been one of the most popular tasks in the field of music information retrieval. With the development of deep learning models, the last decade has seen impressive improvements in a wide range of classification tasks.…

Sound · Computer Science 2023-07-03 Yiwei Ding , Alexander Lerch

The adoption of advanced deep learning architectures in stuttering detection (SD) tasks is challenging due to the limited size of the available datasets. To this end, this work introduces the application of speech embeddings extracted from…

Sound · Computer Science 2023-06-02 Shakeel A. Sheikh , Md Sahidullah , Fabrice Hirsch , Slim Ouni

Deep neural networks (DNNs) excel on fixed datasets but struggle with incremental and shifting data in real-world scenarios. Continual learning addresses this challenge by allowing models to learn from new data while retaining previously…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Lu Yu , Zhe Tao , Dipam Goswami , Hantao Yao , Bartłomiej Twardowski , Joost Van de Weijer , Changsheng Xu

Modeling various aspects that make a music piece unique is a challenging task, requiring the combination of multiple sources of information. Deep learning is commonly used to obtain representations using various sources of information, such…

Sound · Computer Science 2021-04-05 Andres Ferraro , Xavier Favory , Konstantinos Drossos , Yuntae Kim , Dmitry Bogdanov

Most state-of-the-art Deep Learning (DL) approaches for speaker recognition work on a short utterance level. Given the speech signal, these algorithms extract a sequence of speaker embeddings from short segments and those are averaged to…

Sound · Computer Science 2019-07-03 Miquel India , Pooyan Safari , Javier Hernando

Recently, the end-to-end approach that learns hierarchical representations from raw data using deep convolutional neural networks has been successfully explored in the image, text and speech domains. This approach was applied to musical…

Sound · Computer Science 2017-05-23 Jongpil Lee , Jiyoung Park , Keunhyoung Luke Kim , Juhan Nam

The recent development of Audio-based Distributional Semantic Models (ADSMs) enables the computation of audio and lexical vector representations in a joint acoustic-semantic space. In this work, these joint representations are applied to…

Information Retrieval · Computer Science 2016-12-28 Giannis Karamanolakis , Elias Iosif , Athanasia Zlatintsi , Aggelos Pikrakis , Alexandros Potamianos

The careful construction of audio representations has become a dominant feature in the design of approaches to many speech tasks. Increasingly, such approaches have emphasized "disentanglement", where a representation contains only parts of…

The adoption of advanced deep learning (DL) architecture in stuttering detection (SD) tasks is challenging due to the limited size of the available datasets. To this end, this work introduces the application of speech embeddings extracted…

Sound · Computer Science 2022-04-05 Shakeel Ahmad Sheikh , Md Sahidullah , Fabrice Hirsch , Slim Ouni

Deep Learning (DL) algorithms have shown impressive performance in diverse domains. Among them, audio has attracted many researchers over the last couple of decades due to some interesting patterns--particularly in classification of audio…

Sound · Computer Science 2022-06-16 Muhammad Turab , Teerath Kumar , Malika Bendechache , Takfarinas Saber

Large deep-learning models for music, including those focused on learning general-purpose music audio representations, are often assumed to require substantial training data to achieve high performance. If true, this would pose challenges…

Sound · Computer Science 2025-05-12 Christos Plachouras , Emmanouil Benetos , Johan Pauwels

With the advent of modern AI architectures, a shift has happened towards end-to-end architectures. This pivot has led to neural architectures being trained without domain-specific biases/knowledge, optimized according to the task. We in…

Sound · Computer Science 2025-05-08 Prateek Verma

A multi-task learning framework is proposed for optimizing a single deep neural network (DNN) for joint noise reduction (NR) and hearing loss compensation (HLC). A distinct training objective is defined for each task, and the DNN predicts…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-24 Philippe Gonzalez , Vera Margrethe Frederiksen , Torsten Dau , Tobias May

In this paper, we summarize recent progresses made in deep learning based acoustic models and the motivation and insights behind the surveyed techniques. We first discuss acoustic models that can effectively exploit variable-length…

Audio and Speech Processing · Electrical Eng. & Systems 2018-04-30 Dong Yu , Jinyu Li

We present an analysis of large-scale pretrained deep learning models used for cross-modal (text-to-audio) retrieval. We use embeddings extracted by these models in a metric learning framework to connect matching pairs of audio and text.…

Information Retrieval · Computer Science 2022-10-07 Benno Weck , Miguel Pérez Fernández , Holger Kirchhoff , Xavier Serra

Music auto-tagging is often handled in a similar manner to image classification by regarding the 2D audio spectrogram as image data. However, music auto-tagging is distinguished from image classification in that the tags are highly diverse…

Neural and Evolutionary Computing · Computer Science 2017-08-02 Jongpil Lee , Juhan Nam

We capitalize on large amounts of readily-available, synchronous data to learn a deep discriminative representations shared across three major natural modalities: vision, sound and language. By leveraging over a year of sound from video and…

Computer Vision and Pattern Recognition · Computer Science 2017-06-06 Yusuf Aytar , Carl Vondrick , Antonio Torralba

Audio impairment recognition is based on finding noise in audio files and categorising the impairment type. Recently, significant performance improvement has been obtained thanks to the usage of advanced deep learning models. However,…

Audio and Speech Processing · Electrical Eng. & Systems 2021-10-28 Alessandro Ragano , Emmanouil Benetos , Andrew Hines

Latent representation learning has been an active field of study for decades in numerous applications. Inspired among others by the tokenization from Natural Language Processing and motivated by the research of a simple data representation,…

Signal Processing · Electrical Eng. & Systems 2024-09-26 Benoît Giniès , Xiaoyu Bie , Olivier Fercoq , Gaël Richard

Environmental audio tagging is a newly proposed task to predict the presence or absence of a specific audio event in a chunk. Deep neural network (DNN) based methods have been successfully adopted for predicting the audio tags in the…

Sound · Computer Science 2017-02-28 Yong Xu , Qiuqiang Kong , Qiang Huang , Wenwu Wang , Mark D. Plumbley