中文
相关论文

相关论文: Towards Reliable Large Audio Language Model

200 篇论文

The success of large language models (LLMs) has prompted efforts to integrate speech and audio data, aiming to create general foundation models capable of processing both textual and non-textual inputs. Recent advances, such as GPT-4o,…

计算与语言 · 计算机科学 2024-10-18 Fan Bu , Yuhao Zhang , Xidong Wang , Benyou Wang , Qun Liu , Haizhou Li

In this work, we explore the use and reliability of Large Language Models (LLMs) in musicology. From a discussion with experts and students, we assess the current acceptance and concerns regarding this, nowadays ubiquitous, technology. We…

声音 · 计算机科学 2024-09-04 Pedro Ramoneda , Emilia Parada-Cabaleiro , Benno Weck , Xavier Serra

Large language models (LLMs) have exhibited remarkable capabilities across a variety of domains and tasks, challenging our understanding of learning and cognition. Despite the recent success, current LLMs are not capable of processing…

Large Audio Language Models (LALMs), where pretrained text LLMs are finetuned with audio input, have made remarkable progress in music understanding. However, current evaluation methodologies exhibit critical limitations: on the leading…

声音 · 计算机科学 2025-06-11 Yongyi Zang , Sean O'Brien , Taylor Berg-Kirkpatrick , Julian McAuley , Zachary Novack

How does textual representation of audio relate to the Large Language Model's (LLMs) learning about the audio world? This research investigates the extent to which LLMs can be prompted to generate audio, despite their primary training in…

Large Language Models (LLMs) tend to be unreliable in the factuality of their answers. To address this problem, NLP researchers have proposed a range of techniques to estimate LLM's confidence over facts. However, due to the lack of a…

计算与语言 · 计算机科学 2024-11-28 Matéo Mahaut , Laura Aina , Paula Czarnowska , Momchil Hardalov , Thomas Müller , Lluís Màrquez

The proliferation of Large Language Models (LLMs) in medicine has enabled impressive capabilities, yet a critical gap remains in their ability to perform systematic, transparent, and verifiable reasoning, a cornerstone of clinical practice.…

计算与语言 · 计算机科学 2025-08-04 Wenxuan Wang , Zizhan Ma , Meidan Ding , Shiyi Zheng , Shengyuan Liu , Jie Liu , Jiaming Ji , Wenting Chen , Xiang Li , Linlin Shen , Yixuan Yuan

Large Audio Language Models (LALMs) have emerged as powerful tools for speech-related tasks but remain underexplored for fine-tuning, especially with limited speech data. To bridge this gap, we systematically examine how different…

声音 · 计算机科学 2026-01-22 Youngwon Choi , Jaeyoon Jung , Hyeonyu Kim , Huu-Kim Nguyen , Hwayeon Kim

Large Language Models (LLMs) have demonstrated surprising performance across various natural language processing tasks. Recently, medical LLMs enhanced with domain-specific knowledge have exhibited excellent capabilities in medical…

计算与语言 · 计算机科学 2024-09-24 Jinqiang Wang , Huansheng Ning , Yi Peng , Qikai Wei , Daniel Tesfai , Wenwei Mao , Tao Zhu , Runhe Huang

Large Language Models (LLMs) have emerged as a promising cornerstone for the development of natural language processing (NLP) and artificial intelligence (AI). However, ensuring the robustness of LLMs remains a critical challenge. To…

计算与语言 · 计算机科学 2025-11-07 Pankaj Kumar , Subhankar Mishra

Large audio-language models (LALMs) enhance traditional large language models by integrating audio perception capabilities, allowing them to tackle audio-related tasks. Previous research has primarily focused on assessing the performance of…

音频与语音处理 · 电气工程与系统科学 2024-06-13 Chun-Yi Kuan , Wei-Ping Huang , Hung-yi Lee

Large Language Model (LLM) based text-to-speech (TTS) systems have demonstrated remarkable capabilities in handling large speech datasets and generating natural speech for new speakers. However, LLM-based TTS models are not robust as the…

Large language models (LLMs) have been widely used as knowledge backbones of Large Audio Language Models (LALMs), yet how much auditory knowledge they encode through text-only pre-training and how this affects downstream performance remains…

Multimodal Large Language Models (MLLMs) mimic human perception and reasoning system by integrating powerful Large Language Models (LLMs) with various modality encoders (e.g., vision, audio), positioning LLMs as the "brain" and various…

计算机视觉与模式识别 · 计算机科学 2024-08-29 Jiaxing Huang , Jingyi Zhang

Current Large Language Models (LLMs) are unparalleled in their ability to generate grammatically correct, fluent text. LLMs are appearing rapidly, and debates on LLM capacities have taken off, but reflection is lagging behind. Thus, in this…

计算与语言 · 计算机科学 2023-11-01 Bram M. A. van Dijk , Tom Kouwenhoven , Marco R. Spruit , Max J. van Duijn

Although demonstrating remarkable performance on reasoning tasks, Large Language Models (LLMs) still tend to fabricate unreliable responses when confronted with problems that are unsolvable or beyond their capability, severely undermining…

计算与语言 · 计算机科学 2025-11-13 Boyang Xue , Qi Zhu , Rui Wang , Sheng Wang , Hongru Wang , Minda Hu , Fei Mi , Yasheng Wang , Lifeng Shang , Qun Liu , Kam-Fai Wong

Large Audio Language Models (LALMs) have demonstrated strong capabilities in audio understanding and reasoning. However, their performance on fine grained auditory perception remains unreliable, and existing approaches largely rely on data…

声音 · 计算机科学 2026-02-12 Liyang Chen , Hongkai Chen , Yujun Cai , Sifan Li , Qingwen Ye , Yiwei Wang

Large Language Models (LLMs) achieve strong performance on logical reasoning benchmarks, yet their reliability remains uncertain. Existing evaluations rely on static benchmarks, which fail to assess robustness under logically equivalent…

人工智能 · 计算机科学 2026-05-26 Zenghui Zhou , Man Li , Xiaoke Fang , Xinyi Zhou , Weibin Li , Zheng Zheng

Music Recommender Systems (MRS) have long relied on an information-retrieval framing, where progress is measured mainly through accuracy on retrieval-oriented subtasks. While effective, this reductionist paradigm struggles to address the…

信息检索 · 计算机科学 2025-11-21 Elena V. Epure , Yashar Deldjoo , Bruno Sguerra , Markus Schedl , Manuel Moussallam

Large Language Models (LLMs) have achieved remarkable success across a wide range of natural language tasks, and recent efforts have sought to extend their capabilities to multimodal domains and resource-constrained environments. However,…

机器学习 · 计算机科学 2025-05-26 Yun-Da Tsai