English
Related papers

Related papers: Sound Check: Auditing Audio Datasets

200 papers

To help enforce data-protection regulations such as GDPR and detect unauthorized uses of personal data, we develop a new \emph{model auditing} technique that helps users check if their data was used to train a machine learning model. We…

Cryptography and Security · Computer Science 2019-05-21 Congzheng Song , Vitaly Shmatikov

Generative Artificial Intelligence (Gen-AI) models are increasingly used to produce content across domains, including text, images, and audio. While these models represent a major technical breakthrough, they gain their generative…

Machine Learning · Computer Science 2024-12-13 Pascal Epple , Igor Shilov , Bozhidar Stevanoski , Yves-Alexandre de Montjoye

The quantification of audio aesthetics remains a complex challenge in audio processing, primarily due to its subjective nature, which is influenced by human perception and cultural context. Traditional methods often depend on human…

Text-to-image (T2I) generative models are increasingly used to produce content for education, media, and public-facing communication, and are starting to be integrated into higher-impact pipelines. Since generated images tend to reinforce…

Computers and Society · Computer Science 2026-05-14 Jose Luna , Yankun Wu , Xiaofei Xie , Noa Garcia

Music representation learning is central to music information retrieval and generation. While recent advances in multimodal learning have improved alignment between text and audio for tasks such as cross-modal music retrieval, text-to-music…

We present an analysis of a dataset of audio metrics and aesthetic considerations about mixes and masters provided by the web platform MixCheck studio. The platform is designed for educational purposes, primarily targeting amateur music…

Sound · Computer Science 2024-12-05 Angeliki Mourgela , Elio Quinton , Spyridon Bissas , Joshua D. Reiss , David Ronan

Speech datasets are crucial for training Speech Language Technologies (SLT); however, the lack of diversity of the underlying training data can lead to serious limitations in building equitable and robust SLT products, especially along…

Generative AI advances rapidly, allowing the creation of very realistic manipulated video and audio. This progress presents a significant security and ethical threat, as malicious users can exploit DeepFake techniques to spread…

Multimedia · Computer Science 2025-06-09 Marcel Klemt , Carlotta Segna , Anna Rohrbach

Recent advances in text-to-music generation enable high-fidelity synthesis of structured musical audio, raising growing concerns about data provenance, consent, and training transparency. These models are typically trained on large-scale…

Machine Learning · Computer Science 2026-05-29 Yi Chen Liu , Jiawei Yu , Kexin Cao , Syed Irfan Ali Meerza , Trishika Movva , Jian Liu

The rapid growth in user generated content on social media has resulted in a significant rise in demand for automated content moderation. Various methods and frameworks have been proposed for the tasks of hate speech detection and toxic…

Computation and Language · Computer Science 2024-09-27 Elizaveta Korotkova , Isaac Chung

Current research in machine learning and artificial intelligence is largely centered on modeling and performance evaluation, less so on data collection. However, recent research demonstrated that limitations and biases in data may…

Artificial Intelligence · Computer Science 2025-02-18 Eleonora Mancini , Ana Tanevska , Andrea Galassi , Alessio Galatolo , Federico Ruggeri , Paolo Torroni

Research on generative systems in music has seen considerable attention and growth in recent years. A variety of attempts have been made to systematically evaluate such systems. We present an interdisciplinary review of the common…

Sound · Computer Science 2025-09-23 Alexander Lerch , Claire Arthur , Nick Bryan-Kinns , Corey Ford , Qianyi Sun , Ashvala Vinay

Text-To-Music (TTM) models have recently revolutionized the automatic music generation research field. Specifically, by reaching superior performances to all previous state-of-the-art models and by lowering the technical proficiency needed…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-26 Luca Comanducci , Paolo Bestagini , Stefano Tubaro

Hate speech represents a pervasive and detrimental form of online discourse, often manifested through an array of slurs, from hateful tweets to defamatory posts. As such speech proliferates, it connects people globally and poses significant…

Computation and Language · Computer Science 2025-05-06 Paloma Piot , Patricia Martín-Rodilla , Javier Parapar

Online hate speech is a recent problem in our society that is rising at a steady pace by leveraging the vulnerabilities of the corresponding regimes that characterise most social media platforms. This phenomenon is primarily fostered by…

Computation and Language · Computer Science 2022-01-05 Ioannis Mollas , Zoe Chrysopoulou , Stamatis Karlos , Grigorios Tsoumakas

Recent advances in foundation models have enabled audio-generative models that produce high-fidelity sounds associated with music, events, and human actions. Despite the success achieved in modern audio-generative models, the conventional…

Sound · Computer Science 2024-08-30 Tiantian Feng , Dimitrios Dimitriadis , Shrikanth Narayanan

With increasing amounts of music being digitally transferred from production to distribution, automatic means of determining media quality are needed. Protection mechanisms in digital audio processing tools have not eliminated the need of…

Sound · Computer Science 2022-02-14 Daniel Wolff , Rémi Mignot , Axel Roebel

We present a study that explores the role of user-centred design in developing Generative AI (GenAI) tools for music composition. Through semi-structured interviews with professional composers, we gathered insights on a novel generative…

Sound · Computer Science 2024-12-17 Eleanor Row , György Fazekas

Despite the growing reliance on fairness benchmarks to evaluate language models, the datasets that underpin these benchmarks remain critically underexamined. This survey addresses that overlooked foundation by offering a comprehensive…

Computation and Language · Computer Science 2025-09-23 Jiale Zhang , Zichong Wang , Avash Palikhe , Zhipeng Yin , Wenbin Zhang

The introduction of audio latent diffusion models possessing the ability to generate realistic sound clips on demand from a text description has the potential to revolutionize how we work with audio. In this work, we make an initial attempt…

Audio and Speech Processing · Electrical Eng. & Systems 2023-10-17 Dimitrios Bralios , Gordon Wichern , François G. Germain , Zexu Pan , Sameer Khurana , Chiori Hori , Jonathan Le Roux