English
Related papers

Related papers: AISTAT lab system for DCASE2025 Task6: Language-ba…

200 papers

This paper introduces the task description for the Detection and Classification of Acoustic Scenes and Events (DCASE) 2025 Challenge Task 2, titled "First-shot unsupervised anomalous sound detection (ASD) for machine condition monitoring".…

Foley sound generation, the art of creating audio for multimedia, has recently seen notable advancements through text-conditioned latent diffusion models. These systems use multimodal text-audio representation models, such as Contrastive…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-15 Tornike Karchkhadze , Hassan Salami Kavaki , Mohammad Rasool Izadi , Bryce Irvin , Mikolaj Kegler , Ari Hertz , Shuo Zhang , Marko Stamenovic

This report describes the submission system of the GIST-AiTeR team at the 2022 VoxCeleb Speaker Recognition Challenge (VoxSRC) Track 4. Our system mainly includes speech enhancement, voice activity detection , multi-scaled speaker…

Audio and Speech Processing · Electrical Eng. & Systems 2022-10-07 Dongkeon Park , Yechan Yu , Kyeong Wan Park , Ji Won Kim , Hong Kook Kim

Many applications of speech technology require more and more audio data. Automatic assessment of the quality of the collected recordings is important to ensure they meet the requirements of the related applications. However, effective and…

Audio and Speech Processing · Electrical Eng. & Systems 2020-05-19 Qiang Huang , Thomas Hain

Language-queried Audio Separation (LASS) employs linguistic queries to isolate target sounds based on semantic descriptions. However, existing methods face challenges in aligning complex auditory features with linguistic context while…

Sound · Computer Science 2025-06-23 Jianyuan Feng , Guangzheng Li , Yangfei Xu

Environmental sound detection is a challenging application of machine learning because of the noisy nature of the signal, and the small amount of (labeled) data that is typically available. This work thus presents a comparison of several…

Sound · Computer Science 2017-03-22 Juncheng Li , Wei Dai , Florian Metze , Shuhui Qu , Samarjit Das

Audio event has a hierarchical architecture in both time and frequency and can be grouped together to construct more abstract semantic audio classes. In this work, we develop a multiscale audio spectrogram Transformer (MAST) that employs…

Sound · Computer Science 2023-03-21 Wentao Zhu , Mohamed Omar

The ICASSP 2022 Acoustic Echo Cancellation Challenge is intended to stimulate research in acoustic echo cancellation (AEC), which is an important area of speech enhancement and still a top issue in audio communication. This is the third AEC…

Audio and Speech Processing · Electrical Eng. & Systems 2022-03-01 Ross Cutler , Ando Saabas , Tanel Parnamaa , Marju Purin , Hannes Gamper , Sebastian Braun , Karsten Sørensen , Robert Aichner

In traditional audio captioning methods, a model is usually trained in a fully supervised manner using a human-annotated dataset containing audio-text pairs and then evaluated on the test sets from the same dataset. Such methods have two…

Sound · Computer Science 2024-06-11 Yiming Zhang , Xuenan Xu , Ruoyi Du , Haohe Liu , Yuan Dong , Zheng-Hua Tan , Wenwu Wang , Zhanyu Ma

This paper presents a novel Dialect Identification (DID) system developed for the Fifth Edition of the Multi-Genre Broadcast challenge, the task of Fine-grained Arabic Dialect Identification (MGB-5 ADI Challenge). The system improves upon…

Audio and Speech Processing · Electrical Eng. & Systems 2019-12-20 Xiaoxiao Miao , Ian McLoughlin

In this paper, we are interested in exploiting textual and acoustic data of an utterance for the speech emotion classification task. The baseline approach models the information from audio and text independently using two deep neural…

Audio and Speech Processing · Electrical Eng. & Systems 2019-12-02 Seunghyun Yoon , Seokhyun Byun , Subhadeep Dey , Kyomin Jung

Automated Audio Captioning (AAC) aims to generate natural textual descriptions for input audio signals. Recent progress in audio pre-trained models and large language models (LLMs) has significantly enhanced audio understanding and textual…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-15 Wenxi Chen , Ziyang Ma , Xiquan Li , Xuenan Xu , Yuzhe Liang , Zhisheng Zheng , Kai Yu , Xie Chen

Meetings are a valuable yet challenging scenario for speech applications due to complex acoustic conditions. This paper summarizes the outcomes of the MISP 2025 Challenge, hosted at Interspeech 2025, which focuses on multi-modal,…

To address Task 5 in the Detection and Classification of Acoustic Scenes and Events (DCASE) 2018 challenge, in this paper, we propose an ensemble learning system. The proposed system consists of three different models, based on…

Audio and Speech Processing · Electrical Eng. & Systems 2018-12-13 Jeremy Chew , Yingxiang Sun , Lahiru Jayasinghe , Chau Yuen

Recent advancement of large language models (LLMs) has led to significant breakthroughs across various tasks, laying the foundation for the development of LLM-based speech translation systems. Existing methods primarily focus on aligning…

Computation and Language · Computer Science 2025-03-14 Henglyu Liu , Andong Chen , Kehai Chen , Xuefeng Bai , Meizhi Zhong , Yuan Qiu , Min Zhang

Despite recent progress in text-to-audio (TTA) generation, we show that the state-of-the-art models, such as AudioLDM, trained on datasets with an imbalanced class distribution, such as AudioCaps, are biased in their generation performance.…

Sound · Computer Science 2024-01-08 Yi Yuan , Haohe Liu , Xubo Liu , Qiushi Huang , Mark D. Plumbley , Wenwu Wang

Attention is the core mechanism of today's most used architectures for natural language processing and has been analyzed from many perspectives, including its effectiveness for machine translation-related tasks. Among these studies,…

Computation and Language · Computer Science 2026-02-04 Sara Papi , Marco Turchi , Matteo Negri

Large language models (LLMs) have shown great promise for capturing contextual information in natural language processing tasks. We propose a novel approach to speaker diarization that incorporates the prowess of LLMs to exploit contextual…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-15 Tae Jin Park , Kunal Dhawan , Nithin Koluguri , Jagadeesh Balam

Many studies combine text and audio to capture multi-modal information but they overlook the model's generalization ability on new datasets. Introducing new datasets may affect the feature space of the original dataset, leading to…

Sound · Computer Science 2025-07-29 Yingfei Sun , Xu Gu , Wei Ji , Hanbin Zhao , Yifang Yin , Roger Zimmermann

In this paper, we propose a simple yet powerful improvement over the recent Self-Supervised Audio Spectrogram Transformer (SSAST) model for speech and audio classification. Specifically, we leverage the insight that the SSAST uses a very…

Audio and Speech Processing · Electrical Eng. & Systems 2022-04-01 Alan Baade , Puyuan Peng , David Harwath