English
Related papers

Related papers: Sound Scene Synthesis at the DCASE 2024 Challenge

200 papers

This is the summary paper for the AudioMOS Challenge 2025, the very first challenge for automatic subjective quality prediction for synthetic audio. The challenge consists of three tracks. The first track aims to assess text-to-music…

The majority of sound scene analysis work focuses on one of two clearly defined tasks: acoustic scene classification or sound event detection. Whilst this separation of tasks is useful for problem definition, they inherently ignore some…

Audio and Speech Processing · Electrical Eng. & Systems 2019-07-30 Helen L. Bear , Toni Heittola , Annamaria Mesaros , Emmanouil Benetos , Tuomas Virtanen

The DCASE 2018 Challenge consists of five tasks related to automatic classification and detection of sound events and scenes. This paper presents the setup of Task 5 which includes the description of the task, dataset and the baseline…

Audio and Speech Processing · Electrical Eng. & Systems 2018-08-02 Gert Dekkers , Lode Vuegen , Toon van Waterschoot , Bart Vanrumste , Peter Karsmakers

Sound, as a crucial sensory channel, plays a vital role in improving the reality and immersiveness of a virtual environment, following only vision in importance. Sound can provide important clues such as sound directionality and spatial…

Sound · Computer Science 2021-05-05 Shiguang Liu , Dinesh Manocha

Acoustic Scene Classification (ASC) and Sound Event Detection (SED) are two separate tasks in the field of computational sound scene analysis. In this work, we present a new dataset with both sound scene and sound event labels and use this…

Audio and Speech Processing · Electrical Eng. & Systems 2019-07-02 Helen L. Bear , Ines Nolasco , Emmanouil Benetos

Noise synthesis is a challenging low-level vision task aiming to generate realistic noise given a clean image along with the camera settings. To this end, we propose an effective generative model which utilizes clean features as guidance…

Computer Vision and Pattern Recognition · Computer Science 2024-06-14 Mingyang Song , Yang Zhang , Tunç O. Aydın , Elham Amin Mansour , Christopher Schroers

This study aims to investigate the challenge of insufficient three-dimensional context in synthetic datasets for scene text rendering. Although recent advances in diffusion models and related techniques have improved certain aspects of…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Li-Syun Hsiung , Jun-Kai Tu , Kuan-Wu Chu , Yu-Hsuan Chiu , Yan-Tsung Peng , Sheng-Luen Chung , Gee-Sern Jison Hsu

In daily life, social interaction and acoustic communication often take place in complex acoustic environments (CAE) with a variety of interfering sounds and reverberation. For hearing research and the evaluation of hearing systems,…

Audio and Speech Processing · Electrical Eng. & Systems 2021-11-30 Stefan Fichna , Thomas Biberger , Bernhard U. Seeber , Stephan D. Ewert

In this paper, we present deep learning frameworks for audio-visual scene classification (SC) and indicate how individual visual and audio features as well as their combination affect SC performance. Our extensive experiments, which are…

Sound · Computer Science 2021-06-17 Lam Pham , Alexander Schindler , Mina Schütz , Jasmin Lampert , Sven Schlarb , Ross King

We present the task description and discussion on the results of the DCASE 2021 Challenge Task 2. In 2020, we organized an unsupervised anomalous sound detection (ASD) task, identifying whether a given sound was normal or anomalous without…

Audio and Speech Processing · Electrical Eng. & Systems 2021-09-28 Yohei Kawaguchi , Keisuke Imoto , Yuma Koizumi , Noboru Harada , Daisuke Niizumi , Kota Dohi , Ryo Tanabe , Harsh Purohit , Takashi Endo

We present CineVerse, a novel framework for the task of cinematic scene composition. Similar to traditional multi-shot generation, our task emphasizes the need for consistency and continuity across frames. However, our task also focuses on…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Quynh Phung , Long Mai , Fabian David Caba Heilbron , Feng Liu , Jia-Bin Huang , Cusuh Ham

This paper presents DCASE 2018 task 4. The task evaluates systems for the large-scale detection of sound events using weakly labeled data (without time boundaries). The target of the systems is to provide not only the event class but also…

Sound · Computer Science 2018-07-30 Romain Serizel , Nicolas Turpault , Hamid Eghbal-Zadeh , Ankit Parag Shah

Sound event localization and detection with source distance estimation (3D SELD) involves not only identifying the sound category and its direction-of-arrival (DOA) but also predicting the source's distance, aiming to provide full…

Audio and Speech Processing · Electrical Eng. & Systems 2024-11-22 Hengyi Hong , Qing Wang , Jun Du , Ruoyu Wei , Mingqi Cai , Xin Fang

3D scene generation seeks to synthesize spatially structured, semantically meaningful, and photorealistic environments for applications such as immersive media, robotics, autonomous driving, and embodied AI. Early methods based on…

Computer Vision and Pattern Recognition · Computer Science 2025-05-09 Beichen Wen , Haozhe Xie , Zhaoxi Chen , Fangzhou Hong , Ziwei Liu

Many datasets have been designed to further the development of fake audio detection. However, fake utterances in previous datasets are mostly generated by altering timbre, prosody, linguistic content or channel noise of original audio.…

The INTERSPEECH 2020 Deep Noise Suppression (DNS) Challenge is intended to promote collaborative research in real-time single-channel Speech Enhancement aimed to maximize the subjective (perceptual) quality of the enhanced speech. A typical…

Future Frame Synthesis (FFS), the task of generating subsequent video frames from context, represents a core challenge in machine intelligence and a cornerstone for developing predictive world models. This survey provides a comprehensive…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Ruibo Ming , Zhewei Huang , Jingwei Wu , Zhuoxuan Ju , Daxin Jiang , Jianming Hu , Lihui Peng , Shuchang Zhou

Recent progress in audio generation has made it increasingly easy to create highly realistic environmental soundscapes, which can be misused to produce deceptive content, such as fake alarms, gunshots, and crowd sounds, raising concerns for…

Sound · Computer Science 2026-03-10 Han Yin , Yang Xiao , Rohan Kumar Das , Jisheng Bai , Ting Dang

Immersive communication has made significant advancements, especially with the release of the codec for Immersive Voice and Audio Services. Aiming at its further realization, the DCASE 2025 Challenge has recently introduced a task for…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-10 Binh Thien Nguyen , Masahiro Yasuda , Daiki Takeuchi , Daisuke Niizumi , Yasunori Ohishi , Noboru Harada

Audio deepfake detection is an emerging topic, which was included in the ASVspoof 2021. However, the recent shared tasks have not covered many real-life and challenging scenarios. The first Audio Deep synthesis Detection challenge (ADD) was…