English
Related papers

Related papers: Are you really listening? Boosting Perceptual Awar…

200 papers

Recent advancements in large audio language models (LALMs) have demonstrated impressive results and promising prospects in universal understanding and reasoning across speech, music, and general sound. However, these models still lack the…

Large audio language models (LALMs) leverage multimodal representations to generate open-ended answers to natural language queries about audio. In this paper, we (1) provide empirical evidence that assessment of LALMs using the popular…

Sound · Computer Science 2026-05-28 Daniel Chenyu Lin , Michael Freeman , John Thickstun

The evaluation of music understanding in Large Audio-Language Models (LALMs) requires a rigorously defined benchmark that truly tests whether models can perceive and interpret music, a standard that current data methodologies frequently…

Computation and Language · Computer Science 2026-03-31 Benno Weck , Pablo Puentes , Andrea Poltronieri , Satyajeet Prabhu , Dmitry Bogdanov

Understanding emotion from speech requires sensitivity to both lexical and acoustic cues. However, it remains unclear whether large audio language models (LALMs) genuinely process acoustic information or rely primarily on lexical content.…

Computation and Language · Computer Science 2025-10-20 Jingyi Chen , Zhimeng Guo , Jiyun Chun , Pichao Wang , Andrew Perrault , Micha Elsner

Large Audio-Language Models show consistent performance gains across speech and audio benchmarks, yet high scores may not reflect true auditory perception. If a model can answer questions without processing the acoustic signal, the…

Sound · Computer Science 2026-04-28 Leonardo Haw-Yang Foo , Chih-Kai Yang , Chen-An Li , Ke-Han Lu , Hung-yi Lee

Large Audio-Language Models (LALMs) have recently achieved strong performance across various audio-centric tasks. However, hallucination, where models generate responses that are semantically incorrect or acoustically unsupported, remains…

Sound · Computer Science 2026-04-22 Feiyu Zhao , Yiming Chen , Wenhuan Lu , Daipeng Zhang , Xianghu Yue , Jianguo Wei

Audio Large Language Models (Audio LLMs) enable human-like conversation about music, yet it is unclear if they are truly listening to the audio or just using textual reasoning, as recent benchmarks suggest. This paper investigates this…

Machine Learning · Computer Science 2026-05-18 Giovana Morais , Magdalena Fuentes

Large Audio-Language Models (LALMs) are enhanced with audio perception capabilities, enabling them to effectively process and understand multimodal inputs that combine audio and text. However, their performance in handling conflicting…

Computation and Language · Computer Science 2025-08-22 Cheng Wang , Gelei Deng , Xianglin Yang , Han Qiu , Tianwei Zhang

Multimodal Large Language Models (MLLMs) have demonstrated capabilities in audio understanding, but current evaluations may obscure fundamental weaknesses in relational reasoning. We introduce the Music Understanding and Structural…

Artificial Intelligence · Computer Science 2025-10-23 Brandon James Carone , Iran R. Roman , Pablo Ripollés

Recent advances in audio-text large language models (LLMs) have opened new possibilities for music understanding and generation. However, existing benchmarks are limited in scope, often relying on simplified tasks or multi-choice…

Audio and Speech Processing · Electrical Eng. & Systems 2025-07-01 Yinghao Ma , Siyou Li , Juntao Yu , Emmanouil Benetos , Akira Maezawa

Large Audio Language Models (LALMs) have emerged as powerful tools for speech-related tasks but remain underexplored for fine-tuning, especially with limited speech data. To bridge this gap, we systematically examine how different…

Sound · Computer Science 2026-01-22 Youngwon Choi , Jaeyoon Jung , Hyeonyu Kim , Huu-Kim Nguyen , Hwayeon Kim

Recent Large Audio-Language Models (LALMs) exhibit impressive capabilities in understanding audio content for conversational QA tasks. However, these models struggle to accurately understand timestamps for temporal localization (e.g.,…

Sound · Computer Science 2025-12-15 Hualei Wang , Yiming Li , Shuo Ma , Hong Liu , Xiangdong Wang

Recent advances in large audio language models (LALMs) have primarily been assessed using a multiple-choice question answering (MCQA) framework. However, subtle changes, such as shifting the order of choices, result in substantially…

Computation and Language · Computer Science 2025-10-07 Fernando López , Santosh Kesiraju , Jordi Luque

Recent advancements in large audio-language models (LALMs) have shown impressive capabilities in understanding and reasoning about audio and speech information. However, these models still face challenges, including hallucinating…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-03 Chun-Yi Kuan , Hung-yi Lee

Recent Audio Multimodal Large Language Models (Audio MLLMs) demonstrate impressive performance on speech benchmarks, yet it remains unclear whether these models genuinely process acoustic signals or rely on text-based semantic inference. To…

Artificial Intelligence · Computer Science 2026-03-23 Jiaqi Xiong , Yunjia Qi , Qi Cao , Yu Zheng , Yutong Zhang , Ziteng Wang , Ruofan Liao , Weisheng Xu , Sichen Liu

The rise of music large language models (LLMs) demands robust methods of evaluating output quality, especially in distinguishing high-quality compositions from "garbage music". Curiously, we observe that the standard cross-entropy loss -- a…

Sound · Computer Science 2026-02-04 Xiaosha Li , Chun Liu , Ziyu Wang

Music Recommender Systems (MRS) have long relied on an information-retrieval framing, where progress is measured mainly through accuracy on retrieval-oriented subtasks. While effective, this reductionist paradigm struggles to address the…

Information Retrieval · Computer Science 2025-11-21 Elena V. Epure , Yashar Deldjoo , Bruno Sguerra , Markus Schedl , Manuel Moussallam

Recently, Large Audio Language Models (LALMs) have progressed rapidly, demonstrating their strong efficacy in universal audio understanding through cross-modal integration. To evaluate LALMs' audio understanding performance, researchers…

Sound · Computer Science 2026-02-16 Han Yin , Jung-Woo Choi

Large Audio Language Models (LALMs), which couple acoustic perception with large language models (LLMs) to extract and understand diverse information from audio, have attracted intense interest from both academic and industrial communities.…

Sound · Computer Science 2025-10-28 Bohan Li , Wenbin Huang , Yuhang Qiu , Yiwei Guo , Hankun Wang , Zhihan Li , Jing Peng , Ziyang Ma , Xie Chen , Kai Yu

Large audio-language models (LALMs) enhance traditional large language models by integrating audio perception capabilities, allowing them to tackle audio-related tasks. Previous research has primarily focused on assessing the performance of…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-13 Chun-Yi Kuan , Wei-Ping Huang , Hung-yi Lee
‹ Prev 1 2 3 10 Next ›