English
Related papers

Related papers: AISTAT lab system for DCASE2025 Task6: Language-ba…

200 papers

We present work on deception detection, where, given a spoken claim, we aim to predict its factuality. While previous work in the speech community has relied on recordings from staged setups where people were asked to tell the truth or to…

Computation and Language · Computer Science 2019-10-07 Daniel Kopev , Ahmed Ali , Ivan Koychev , Preslav Nakov

Large Language Models (LLMs) are currently under exploration for various tasks, including Automatic Speech Recognition (ASR), Machine Translation (MT), and even End-to-End Speech Translation (ST). In this paper, we present KIT's offline…

Computation and Language · Computer Science 2024-06-25 Sai Koneru , Thai-Binh Nguyen , Ngoc-Quan Pham , Danni Liu , Zhaolin Li , Alexander Waibel , Jan Niehues

Audio-native large language models (audio-LLMs) commonly use Whisper as their audio encoder. However, Whisper was trained exclusively on speech data, producing weak representations for music and environmental sound. This forces downstream…

This paper proposes a method for unsupervised anomalous sound detection (UASD) and captioning the reason for detection. While there is a method that captions the difference between given normal and anomalous sound pairs, it is assumed to be…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-30 Ryoya Ogura , Tomoya Nishida , Yohei Kawaguchi

This paper presents the details of our system designed for the Task 1 of Multimodal Information Based Speech Processing (MISP) Challenge 2021. The purpose of Task 1 is to leverage both audio and video information to improve the…

This paper describes our submitted systems to the 2022 ADD challenge withing the tracks 1 and 2. Our approach is based on the combination of a pre-trained wav2vec2 feature extractor and a downstream classifier to detect spoofed audio. This…

Audio and Speech Processing · Electrical Eng. & Systems 2022-03-04 Juan M. Martín-Doñas , Aitor Álvarez

The past few years have witnessed the significant advances of speech synthesis and voice conversion technologies. However, such technologies can undermine the robustness of broadly implemented biometric identification models and can be…

Audio and Speech Processing · Electrical Eng. & Systems 2022-02-16 Haibin Wu , Heng-Cheng Kuo , Naijun Zheng , Kuo-Hsuan Hung , Hung-Yi Lee , Yu Tsao , Hsin-Min Wang , Helen Meng

Automatic Speech Recognition (ASR) systems have attained unprecedented performance with large speech models pre-trained based on self-supervised speech representation learning. However, these pre-trained speech models suffer from…

Computation and Language · Computer Science 2023-05-29 Eunseop Yoon , Hee Suk Yoon , John Harvill , Mark Hasegawa-Johnson , Chang D. Yoo

Despite the success of deep learning in speech recognition, multi-dialect speech recognition remains a difficult problem. Although dialect-specific acoustic models are known to perform well in general, they are not easy to maintain when…

Machine Learning · Computer Science 2022-05-09 Sanghyun Yoo , Inchul Song , Yoshua Bengio

This paper presents the details of Task 1A Acoustic Scene Classification in the DCASE 2021 Challenge. The task targeted development of low-complexity solutions with good generalization properties. The provided baseline system is based on a…

Audio and Speech Processing · Electrical Eng. & Systems 2021-07-21 Irene Martín-Morató , Toni Heittola , Annamaria Mesaros , Tuomas Virtanen

End-to-end (E2E) models have made rapid progress in automatic speech recognition (ASR) and perform competitively relative to conventional models. To further improve the quality, a two-pass model has been proposed to rescore streamed…

Audio and Speech Processing · Electrical Eng. & Systems 2020-03-19 Ke Hu , Tara N. Sainath , Ruoming Pang , Rohit Prabhavalkar

Large language model (LLM)-based automatic speech recognition (ASR) has recently achieved strong performance across diverse tasks, yet contextual biasing for named entities and hotwords under large vocabularies remains challenging. In this…

Audio and Speech Processing · Electrical Eng. & Systems 2025-12-29 YuXiang Kong , JunFeng Hou , Jian Tang , Bingqing Zhu , Jicheng Zhang , Shaofei Xue

Speech Large Language Models (LLMs) that understand and follow instructions in many languages are useful for real-world interaction, but are difficult to train with supervised fine-tuning, requiring large, task-specific speech corpora.…

Computation and Language · Computer Science 2026-03-10 Shreyas Gopal , Donghang Wu , Ashutosh Anshul , Yeo Yue Heng , Yizhou Peng , Haoyang Li , Hexin Liu , Eng Siong Chng

This paper presents the Duluth approach to the SemEval-2025 Task 7 on Multilingual and Crosslingual Fact-Checked Claim Retrieval. We implemented a TF-IDF-based retrieval system with experimentation on vector dimensions and tokenization…

Computation and Language · Computer Science 2025-05-20 Shujauddin Syed , Ted Pedersen

Recent advancements in multimodal reasoning have largely overlooked the audio modality. We introduce Audio-Reasoner, a large-scale audio language model for deep reasoning in audio tasks. We meticulously curated a large-scale and diverse…

Sound · Computer Science 2025-09-23 Zhifei Xie , Mingbao Lin , Zihang Liu , Pengcheng Wu , Shuicheng Yan , Chunyan Miao

This work proposes a grammar-based chunking strategy that segments input streams into semantically complete units by parsing dependency relations (e.g., noun phrase boundaries, verb-object structures) and punctuation features. The method…

Computation and Language · Computer Science 2025-08-12 Zeyu Yang , Lai Wei , Roman Koshkin , Xi Chen , Satoshi Nakamura

This paper addresses performance degradation in anomalous sound detection (ASD) when neither sufficiently similar machine data nor operational state labels are available. We present an integrated pipeline that combines three complementary…

Sound · Computer Science 2025-05-27 Ibuki Kuroyanagi , Takuya Fujimura , Kazuya Takeda , Tomoki Toda

An ideal audio retrieval system efficiently and robustly recognizes a short query snippet from an extensive database. However, the performance of well-known audio fingerprinting systems falls short at high signal distortion levels. This…

Audio and Speech Processing · Electrical Eng. & Systems 2024-11-22 Anup Singh , Kris Demuynck , Vipul Arora

Deep neural networks have become an indispensable technique for audio source separation (ASS). It was recently reported that a variant of CNN architecture called MMDenseNet was successfully employed to solve the ASS problem of estimating…

Sound · Computer Science 2018-05-30 Naoya Takahashi , Nabarun Goswami , Yuki Mitsufuji

This paper describes USTC-NELSLIP's submissions to the IWSLT2021 Simultaneous Speech Translation task. We proposed a novel simultaneous translation model, Cross Attention Augmented Transducer (CAAT), which extends conventional RNN-T to…

Computation and Language · Computer Science 2021-07-12 Dan Liu , Mengge Du , Xiaoxi Li , Yuchen Hu , Lirong Dai