English
Related papers

Related papers: The ICME 2025 Audio Encoder Capability Challenge

200 papers

While Large Audio-Language Models (LALMs) have been shown to exhibit degraded instruction-following capabilities, their ability to infer task patterns from in-context examples under audio conditioning remains unstudied. To address this gap,…

Despite the growing interest in unsupervised learning, extracting meaningful knowledge from unlabelled audio remains an open challenge. To take a step in this direction, we recently proposed a problem-agnostic speech encoder (PASE), that…

Audio and Speech Processing · Electrical Eng. & Systems 2020-04-21 Mirco Ravanelli , Jianyuan Zhong , Santiago Pascual , Pawel Swietojanski , Joao Monteiro , Jan Trmal , Yoshua Bengio

End-to-end speech translation poses a heavy burden on the encoder, because it has to transcribe, understand, and learn cross-lingual semantics simultaneously. To obtain a powerful encoder, traditional methods pre-train it on ASR data to…

Computation and Language · Computer Science 2020-04-22 Chengyi Wang , Yu Wu , Shujie Liu , Ming Zhou , Zhenglu Yang

This paper presents our work for the ICASSP 2026 Environmental Sound Deepfake Detection (ESDD) Challenge. The challenge is based on the large-scale EnvSDD dataset that consists of various synthetic environmental sounds. We focus on…

Sound · Computer Science 2025-12-09 Candy Olivia Mawalim , Haotian Zhang , Shogo Okada

The Inspirational and Convincing Audio Generation Challenge 2024 (ICAGC 2024) is part of the ISCSLP 2024 Competitions and Challenges track. While current text-to-speech (TTS) technology can generate high-quality audio, its ability to convey…

Audio and Speech Processing · Electrical Eng. & Systems 2024-08-01 Ruibo Fu , Rui Liu , Chunyu Qiang , Yingming Gao , Yi Lu , Shuchen Shi , Tao Wang , Ya Li , Zhengqi Wen , Chen Zhang , Hui Bu , Yukun Liu , Xin Qi , Guanjun Li

We present the IEEE-IS2 2024 Music Packet Loss Concealment Challenge. We begin by detailing the challenge rules, followed by an overview of the provided baseline system, the blind test set, and the evaluation methodology used to determine…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-30 Alessandro Ilic Mezza , Alberto Bernardini

We present the first edition of the VoiceMOS Challenge, a scientific event that aims to promote the study of automatic prediction of the mean opinion score (MOS) of synthetic speech. This challenge drew 22 participating teams from academia…

Sound · Computer Science 2022-07-05 Wen-Chin Huang , Erica Cooper , Yu Tsao , Hsin-Min Wang , Tomoki Toda , Junichi Yamagishi

We propose a benchmark for evaluating compositionality in audio representations. Audio compositionality refers to representing sound scenes in terms of constituent sources and attributes, and combining them systematically. While central to…

Sound · Computer Science 2026-03-17 Chuyang Chen , Bea Steers , Brian McFee , Juan Bello

This report summarizes the objectives, datasets, and top-performing methodologies of the 2026 Pixel-level Video Understanding in the Wild (PVUW) Challenge, hosted at CVPR 2026, which evaluates state-of-the-art models under highly…

End-to-end (E2E) models, which directly predict output character sequences given input speech, are good candidates for on-device speech recognition. E2E models, however, present numerous challenges: In order to be truly useful, such models…

Spatial Semantic Segmentation of Sound Scenes (S5) aims to enhance technologies for sound event detection and separation from multi-channel input signals that mix multiple sound events with spatial information. This is a fundamental basis…

This paper reviews the NTIRE 2020 challenge on video quality mapping (VQM), which addresses the issues of quality mapping from source video domain to target video domain. The challenge includes both a supervised track (track 1) and a…

We present a system for automatic multi-axis perceptual quality prediction of generative audio, developed for Track 2 of the AudioMOS Challenge 2025. The task is to predict four Audio Aesthetic Scores--Production Quality, Production…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-04 Dyah A. M. G. Wisnu , Ryandhimas E. Zezario , Stefano Rini , Hsin-Min Wang , Yu Tsao

Speech and audio encoders developed over years of community effort are routinely excluded from video understanding pipelines -- not because they fail, but because benchmarks never required listening. We audit 10 video benchmarks and find…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Geewook Kim , Minjoon Seo

Recent progress in audio generation has made it increasingly easy to create highly realistic environmental soundscapes, which can be misused to produce deceptive content, such as fake alarms, gunshots, and crowd sounds, raising concerns for…

Sound · Computer Science 2026-03-10 Han Yin , Yang Xiao , Rohan Kumar Das , Jisheng Bai , Ting Dang

Real-world speech communication is rarely affected by a single type of degradation. Instead, it suffers from a complex interplay of acoustic interference, codec compression, and, increasingly, secondary artifacts introduced by upstream…

Sound · Computer Science 2025-12-30 Junan Zhang , Mengyao Zhu , Xin Xu , Hui Bu , Zhenhua Ling , Zhizheng Wu

Encoding methods are employed across several process mining tasks, including predictive process monitoring, anomalous case detection, trace clustering, etc. These methods are usually performed as preprocessing steps and are responsible for…

Machine Learning · Computer Science 2023-01-06 Sylvio Barbon , Paolo Ceravolo , Rafael S. Oyamada , Gabriel M. Tavares

This thesis focuses on dealing with the task of acoustic scene classification (ASC), and then applied the techniques developed for ASC to a real-life application of detecting respiratory disease. To deal with ASC challenges, this thesis…

Sound · Computer Science 2021-07-21 Lam Pham

Multimodal-Attributed Graph (MAG) learning has achieved remarkable success in modeling complex real-world systems by integrating graph topology with rich attributes from multiple modalities. With the rapid proliferation of novel MAG models…

Machine Learning · Computer Science 2026-02-06 Chenxi Wan , Xunkai Li , Yilong Zuo , Haokun Deng , Sihan Li , Bowen Fan , Hongchao Qin , Ronghua Li , Guoren Wang

This paper presents the "Speak & Improve Challenge 2025: Spoken Language Assessment and Feedback" -- a challenge associated with the ISCA SLaTE 2025 Workshop. The goal of the challenge is to advance research on spoken language assessment…

Computation and Language · Computer Science 2024-12-18 Mengjie Qian , Kate Knill , Stefano Banno , Siyuan Tang , Penny Karanasou , Mark J. F. Gales , Diane Nicholls