English
Related papers

Related papers: FEARLESS STEPS Challenge (FS-2): Supervised Learni…

200 papers

A variety of complex biological, natural and man-made systems exhibit non-Markovian dynamics that can be modeled through fractional order differential equations, yet, we lack sample comlexity aware system identification strategies. Towards…

Systems and Control · Electrical Eng. & Systems 2025-06-23 Xiaole Zhang , Vijay Gupta , Paul Bogdan

Speech-based analysis offers a scalable and non-invasive approach for detecting cognitive decline, yet progress has been constrained by the limited availability of clinically validated datasets collected under realistic conditions. We…

This paper presents Step-Audio 2, an end-to-end multi-modal large language model designed for industry-strength audio understanding and speech conversation. By integrating a latent audio encoder and reasoning-centric reinforcement learning…

The Barlow Twins self-supervised learning objective requires neither negative samples or asymmetric learning updates, achieving results on a par with the current state-of-the-art within Computer Vision. As such, we present Audio Barlow…

Sound · Computer Science 2022-12-26 Jonah Anton , Harry Coppock , Pancham Shukla , Bjorn W. Schuller

The integration of Federated Learning (FL) and Self-supervised Learning (SSL) offers a unique and synergetic combination to exploit the audio data for general-purpose audio understanding, without compromising user data privacy. However,…

Sound · Computer Science 2024-02-07 Yasar Abbas Ur Rehman , Kin Wai Lau , Yuyang Xie , Lan Ma , Jiajun Shen

Inspired by the humans' cognitive ability to generalise knowledge and skills, Self-Supervised Learning (SSL) targets at discovering general representations from large-scale data without requiring human annotations, which is an expensive and…

First-shot (FS) unsupervised anomalous sound detection (ASD) is a brand-new task introduced in DCASE 2023 Challenge Task 2, where the anomalous sounds for the target machine types are unseen in training. Existing methods often rely on the…

Sound · Computer Science 2024-03-12 Hejing Zhang , Qiaoxi Zhu , Jian Guan , Haohe Liu , Feiyang Xiao , Jiantong Tian , Xinhao Mei , Xubo Liu , Wenwu Wang

The Fearless Steps APOLLO Community Resource provides unparalleled opportunities to explore the potential of multi-speaker team communications from NASA Apollo missions. This study focuses on discovering the characteristics that make Apollo…

Audio and Speech Processing · Electrical Eng. & Systems 2025-12-19 Alkis Koudounas , Flavio Giobergia

We present the task description of the Detection and Classification of Acoustic Scenes and Events (DCASE) 2023 Challenge Task 2: ``First-shot unsupervised anomalous sound detection (ASD) for machine condition monitoring''. The main goal is…

FFSVC2022 is the second challenge of far-field speaker verification. FFSVC2022 provides the fully-supervised far-field speaker verification to further explore the far-field scenario and proposes semi-supervised far-field speaker…

Audio and Speech Processing · Electrical Eng. & Systems 2022-09-19 Xiaoyi Qin , Ming Li , Hui Bu , Shrikanth Narayanan , Haizhou Li

Supervised talking head forgery detection faces severe generalization challenges due to the continuous evolution of generators. By reducing reliance on generator-specific forgery patterns, self-supervised detectors offer stronger…

Computer Vision and Pattern Recognition · Computer Science 2026-05-06 Ke Liu , Jiwei Wei , Shuchang Zhou , Yutong Xiao , Ruikun Chai , Yitong Qin , Yuyang Zhou , Yang Yang

We introduce our submission to the AudioMOS Challenge (AMC) 2025 Track 3: mean opinion score (MOS) prediction for speech with multiple sampling frequencies (SFs). Our submitted model integrates an SF-independent (SFI) convolutional layer…

We evaluate two non-autoregressive architectures, StyleTTS2 and F5-TTS, to address the spontaneous nature of in-the-wild speech. Our models utilize flexible duration modeling to improve prosodic naturalness. To handle acoustic noise, we…

Audio and Speech Processing · Electrical Eng. & Systems 2026-02-06 Jose Giraldo , Alex Peiró-Lilja , Rodolfo Zevallos , Cristina España-Bonet

In this technical report, we describe our submission for the WildSpoof Challenge TTS Track: Text-to-Speech with In-the-Wild Data. We introduce F5-TTS-DPS, a model built upon the F5-TTS architecture. Our approach integrates Exponential…

Audio and Speech Processing · Electrical Eng. & Systems 2026-05-25 Renhe Sun , Jiayi Zhou , Haolin He , Yueying Feng , Jian Liu

The traditional cloud-centric approach for Deep Learning (DL) requires training data to be collected and processed at a central server which is often challenging in privacy-sensitive domains like healthcare. Towards this, a new learning…

Cryptography and Security · Computer Science 2021-11-08 Andreas Grafberger , Mohak Chadha , Anshul Jindal , Jianfeng Gu , Michael Gerndt

The first Natural Office Talkers in Settings of Far-field Audio Recordings (NOTSOFAR-1) Challenge is a pivotal initiative that sets new benchmarks by offering datasets more representative of the needs of real-world business applications…

Sound · Computer Science 2025-03-11 Igor Abramovski , Alon Vinnikov , Shalev Shaer , Naoyuki Kanda , Xiaofei Wang , Amir Ivry , Eyal Krupka

We introduce the Stochastic Correlated Obstacle Scene (SCOS) problem, a navigation setting with spatially correlated obstacles of uncertain blockage status, realistically constrained sensors that provide noisy readings and costly…

Machine Learning · Statistics 2025-10-22 Li Zhou , Elvan Ceyhan

Self-supervised learning representations (SSLR) have resulted in robust features for downstream tasks in many fields. Recently, several SSLRs have shown promising results on automatic speech recognition (ASR) benchmark corpora. However,…

Sound · Computer Science 2022-07-01 Szu-Jui Chen , Jiamin Xie , John H. L. Hansen

Foundation models have shown great success in natural language processing, computer vision, and multimodal tasks. FMs have a large number of model parameters, thus requiring a substantial amount of data to help optimize the model during the…

Machine Learning · Computer Science 2023-12-27 Panlong Wu , Kangshuo Li , Ting Wang , Fangxin Wang

The L3DAS21 Challenge is aimed at encouraging and fostering collaborative research on machine learning for 3D audio signal processing, with particular focus on 3D speech enhancement (SE) and 3D sound localization and detection (SELD).…