English
Related papers

Related papers: Listening Between the Frames: Bridging Temporal Ga…

200 papers

While Large Audio Language Models (LALMs) achieve strong performance on short audio, they degrade on long-form inputs. This degradation is more severe in temporal awareness tasks, where temporal alignment becomes increasingly inaccurate as…

Audio and Speech Processing · Electrical Eng. & Systems 2026-04-27 Mingchen Shao , Hang Su , Wenjie Tian , Bingshen Mu , Zhennan Lin , Lichun Fan , Zhenbo Luo , Jian Luan , Lei Xie

The Audio Question Answering (AQA) task includes audio event classification, audio captioning, and open-ended reasoning. Recently, AQA has garnered attention due to the advent of Large Audio Language Models (LALMs). Current literature…

Sound · Computer Science 2024-12-16 Arvind Krishna Sridhar , Yinyi Guo , Erik Visser

Processing long-form audio is a major challenge for Large Audio Language models (LALMs). These models struggle with the quadratic cost of attention ($O(N^2)$) and with modeling long-range temporal dependencies. Existing audio benchmarks are…

Large Audio-Language Models (LALMs) enable general audio understanding and demonstrate remarkable performance across various audio tasks. However, these models still face challenges in temporal perception (e.g., inferring event onset and…

Sound · Computer Science 2026-04-16 Yanfeng Shi , Pengfei Cai , Jun Liu , Qing Gu , Nan Jiang , Lirong Dai , Ian McLoughlin , Yan Song

While large audio language models (LALMs) have achieved remarkable progress in audio processing at the second- or minute-level scale, understanding hour-level audio remains a fundamental bottleneck. Existing benchmarks predominantly rely on…

Large Audio Language Models (LALMs) are increasingly applied to audio understanding and multimodal reasoning, yet their ability to locate when events occur remains underexplored. We present the first systematic study of temporal bias in…

Computation and Language · Computer Science 2025-10-15 Jiayu Yao , Shenghua Liu , Yiwei Wang , Rundong Cheng , Lingrui Mei , Baolong Bi , Zhen Xiong , Xueqi Cheng

The maturation of Large Audio Language Models (LALMs) has raised growing expectations for them to comprehend complex audio much like humans. Current efforts primarily replicate text-based reasoning by contextualizing audio content through a…

Understanding the internal mechanisms of large audio-language models (LALMs) is crucial for interpreting their behavior and improving performance. This work presents the first in-depth analysis of how LALMs internally perceive and recognize…

Computation and Language · Computer Science 2025-08-26 Chih-Kai Yang , Neo Ho , Yi-Jyun Lee , Hung-yi Lee

With advancements in large audio-language models (LALMs), which enhance large language models (LLMs) with auditory capabilities, these models are expected to demonstrate universal proficiency across various auditory tasks. While numerous…

Audio and Speech Processing · Electrical Eng. & Systems 2026-04-28 Chih-Kai Yang , Neo S. Ho , Hung-yi Lee

Large audio-language models (LALMs) enhance traditional large language models by integrating audio perception capabilities, allowing them to tackle audio-related tasks. Previous research has primarily focused on assessing the performance of…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-13 Chun-Yi Kuan , Wei-Ping Huang , Hung-yi Lee

Recently, Large Audio Language Models (LALMs) have progressed rapidly, demonstrating their strong efficacy in universal audio understanding through cross-modal integration. To evaluate LALMs' audio understanding performance, researchers…

Sound · Computer Science 2026-02-16 Han Yin , Jung-Woo Choi

Recent advancements in large audio-language models (LALMs) have shown impressive capabilities in understanding and reasoning about audio and speech information. However, these models still face challenges, including hallucinating…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-03 Chun-Yi Kuan , Hung-yi Lee

Large Audio-Language Models (LALMs) are enhanced with audio perception capabilities, enabling them to effectively process and understand multimodal inputs that combine audio and text. However, their performance in handling conflicting…

Computation and Language · Computer Science 2025-08-22 Cheng Wang , Gelei Deng , Xianglin Yang , Han Qiu , Tianwei Zhang

In the era of large language models (LLMs) and artificial general intelligence (AGI), computer audition must evolve beyond traditional paradigms to fully leverage the capabilities of foundation models, towards more comprehensive…

Long-form audio understanding poses significant challenges for large audio language models (LALMs) due to the extreme length of audio sequences and the need to reason over heterogeneous acoustic cues distributed over time, such as speech…

Audio and Speech Processing · Electrical Eng. & Systems 2026-05-26 Masao Someki , Chien-yu Huang , Siddhant Arora , Samuele Cornell , Markus Müller , Nathan Susanj , Rupak V Swaminathan , Grant P Strimel , Jing Liu , Shinji Watanabe

Large audio-language models (LALMs) can generate reasoning chains for their predictions, but it remains unclear whether these reasoning chains remain grounded in the input audio. In this paper, we propose an RL-based strategy that grounds…

Sound · Computer Science 2026-03-23 Jihoon Jeong , Pooneh Mousavi , Mirco Ravanelli , Cem Subakan

Large audio language models are increasingly used for complex audio understanding tasks, but they struggle with temporal tasks that require precise temporal grounding, such as word alignment and speaker diarization. The standard approach,…

Machine Learning · Computer Science 2026-02-12 Joesph An , Phillip Keung , Jiaqi Wang , Orevaoghene Ahia , Noah A. Smith

Large Audio-Language Models (LALMs) have recently achieved strong performance across various audio-centric tasks. However, hallucination, where models generate responses that are semantically incorrect or acoustically unsupported, remains…

Sound · Computer Science 2026-04-22 Feiyu Zhao , Yiming Chen , Wenhuan Lu , Daipeng Zhang , Xianghu Yue , Jianguo Wei

The foundational capabilities established by Large Language Models (LLMs) have paved the way for Multimodal Large Language Models (MLLMs), within which Large Audio Language Models (LALMs) are essential for realizing universal auditory…

Recently, instruction-following audio-language models have received broad attention for human-audio interaction. However, the absence of benchmarks capable of evaluating audio-centric interaction capabilities has impeded advancements in…

Audio and Speech Processing · Electrical Eng. & Systems 2024-07-29 Qian Yang , Jin Xu , Wenrui Liu , Yunfei Chu , Ziyue Jiang , Xiaohuan Zhou , Yichong Leng , Yuanjun Lv , Zhou Zhao , Chang Zhou , Jingren Zhou
‹ Prev 1 2 3 10 Next ›