English
Related papers

Related papers: FinAudio: A Benchmark for Audio Large Language Mod…

200 papers

While large audio language models (LALMs) have achieved remarkable progress in audio processing at the second- or minute-level scale, understanding hour-level audio remains a fundamental bottleneck. Existing benchmarks predominantly rely on…

Collecting labeled datasets in finance is challenging due to scarcity of domain experts and higher cost of employing them. While Large Language Models (LLMs) have demonstrated remarkable performance in data annotation tasks on general…

Computation and Language · Computer Science 2024-03-28 Toyin Aguda , Suchetha Siddagangappa , Elena Kochkina , Simerjot Kaur , Dongsheng Wang , Charese Smiley , Sameena Shah

We present FinMMR, a novel bilingual multimodal benchmark tailored to evaluate the reasoning capabilities of multimodal large language models (MLLMs) in financial numerical reasoning tasks. Compared to existing benchmarks, our work…

Language Models (LMs) have demonstrated impressive capabilities with core Natural Language Processing (NLP) tasks. The effectiveness of LMs for highly specialized knowledge-intensive tasks in finance remains difficult to assess due to major…

Computation and Language · Computer Science 2025-06-23 Glenn Matlin , Mika Okamoto , Huzaifa Pardawala , Yang Yang , Sudheer Chava

Financial sentiment analysis is critical for valuation and investment decision-making. Traditional NLP models, however, are limited by their parameter size and the scope of their training datasets, which hampers their generalization…

Computation and Language · Computer Science 2023-11-07 Boyu Zhang , Hongyang Yang , Tianyu Zhou , Ali Babar , Xiao-Yang Liu

Audio-language models (ALMs) generate linguistic descriptions of sound-producing events and scenes. Advances in dataset creation and computational power have led to significant progress in this domain. This paper surveys 69 datasets used to…

Sound · Computer Science 2025-02-10 Gijs Wijngaard , Elia Formisano , Michele Esposito , Michel Dumontier

The combination of Large Language Models (LLM) and Automatic Speech Recognition (ASR), when deployed on edge devices (called edge ASR-LLM), can serve as a powerful personalized assistant to enable audio-based interaction for users. Compared…

Previous studies in automated audio captioning have faced difficulties in accurately capturing the complete temporal details of acoustic scenes and events within long audio sequences. This paper presents AudioLog, a large language models…

Audio and Speech Processing · Electrical Eng. & Systems 2024-01-05 Jisheng Bai , Han Yin , Mou Wang , Dongyuan Shi , Woon-Seng Gan , Jianfeng Chen , Susanto Rahardja

Large audio-language models (LALMs) enhance traditional large language models by integrating audio perception capabilities, allowing them to tackle audio-related tasks. Previous research has primarily focused on assessing the performance of…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-13 Chun-Yi Kuan , Wei-Ping Huang , Hung-yi Lee

Multimodal Large Language Models (MLLMs) have been widely applied in speech and music. This tendency has led to a focus on audio tokenization for Large Models (LMs). Unlike semantic-only text tokens, audio tokens must both capture global…

Sound · Computer Science 2025-09-05 Lu Wang , Hao Chen , Siyu Wu , Zhiyue Wu , Hao Zhou , Chengfeng Zhang , Ting Wang , Haodi Zhang

Listening to heart and lung sounds - auscultation - is one of the first and most fundamental steps in a clinical examination. Despite being fast and non-invasive, it demands years of experience to interpret subtle audio cues. Recent deep…

Machine Learning · Computer Science 2026-03-03 Yishan Wang , Tsai-Ning Wang , Mathias Funk , Aaqib Saeed

Recent advances in audio-language models have demonstrated remarkable success on short, segment-level speech tasks. However, real-world applications such as meeting transcription, spoken document understanding, and conversational analysis…

The creation of high-quality multimodal datasets remains fundamental for advancing role-playing capabilities in large language models (LLMs). While existing works predominantly focus on text-based persona simulation, Audio Role-Playing…

Sound · Computer Science 2026-04-09 Wenyu Li , Xiaoqi Jiao , Yi Chang , Guangyan Zhang , Yiwen Guo

The integration of Large Language Models (LLMs) into financial analysis has garnered significant attention in the NLP community. This paper presents our solution to IJCAI-2024 FinLLM challenge, investigating the capabilities of LLMs within…

Computational Engineering, Finance, and Science · Computer Science 2024-07-03 Yupeng Cao , Zhiyuan Yao , Zhi Chen , Zhiyang Deng

Large Language Models (LLMs) exhibit considerable promise in financial applications; however, prevailing models frequently demonstrate limitations when confronted with scenarios that necessitate sophisticated reasoning capabilities,…

Computation and Language · Computer Science 2025-07-29 Yanjun Zheng , Xiyang Du , Longfei Liao , Xiaoke Zhao , Zhaowen Zhou , Jingze Song , Bo Zhang , Jiawei Liu , Xiang Qi , Zhe Li , Zhiqiang Zhang , Wei Wang , Peng Zhang

Large Language Models (LLMs) demonstrate impressive zero-shot performance across a wide range of natural language processing tasks. Integrating various modality encoders further expands their capabilities, giving rise to Multimodal Large…

Sound · Computer Science 2026-01-13 Hao Cheng , Erjia Xiao , Jing Shao , Yichi Wang , Le Yang , Chao Shen , Philip Torr , Jindong Gu , Renjing Xu

Large language models (LLMs) are increasingly deployed in financial contexts, raising critical concerns about reliability, alignment, and susceptibility to adversarial manipulation. While prior finance-related benchmarks assess LLMs'…

Computation and Language · Computer Science 2026-05-12 Xiaoyu Hu , Jinman Zhao

This paper presents the Interspeech 2026 Audio Encoder Capability Challenge, a benchmark specifically designed to evaluate and advance the performance of pre-trained audio encoders as front-end modules for Large Audio Language Models…

The development of Large Speech-Language Models (LSLMs) has been slowed by fragmented architectures and a lack of transparency, hindering the systematic comparison and reproducibility of research. Unlike in the vision-language domain, the…

Computation and Language · Computer Science 2025-08-22 Yirong Sun , Yizhong Geng , Peidong Wei , Yanjun Chen , Jinghan Yang , Rongfei Chen , Wei Zhang , Xiaoyu Shen

FinanceQA is a testing suite that evaluates LLMs' performance on complex numerical financial analysis tasks that mirror real-world investment work. Despite recent advances, current LLMs fail to meet the strict accuracy requirements of…

Machine Learning · Computer Science 2025-01-31 Spencer Mateega , Carlos Georgescu , Danny Tang
‹ Prev 1 4 5 6 7 8 10 Next ›