中文
相关论文

相关论文: Fine-Tuning Large Multimodal Models for Automatic …

200 篇论文

Large language models (LLMs) have achieved remarkable performance in recent years but are fundamentally limited by the underlying training data. To improve models beyond the training data, recent works have explored how LLMs can be used to…

计算与语言 · 计算机科学 2025-03-04 Vighnesh Subramaniam , Yilun Du , Joshua B. Tenenbaum , Antonio Torralba , Shuang Li , Igor Mordatch

An accurate assessment of L2 English pronunciation is crucial for language learning, as it provides personalized feedback and ensures a fair evaluation of individual progress. However, automated scoring remains challenging due to the…

音频与语音处理 · 电气工程与系统科学 2026-01-26 Aditya Kamlesh Parikh , Cristian Tejedor-Garcia , Catia Cucchiarini , Helmer Strik

This study explores the capability of Large Language Models (LLMs) to evaluate causality in causal graphs generated by conventional statistical causal discovery methods-a task traditionally reliant on manual assessment by human subject…

计算与语言 · 计算机科学 2025-04-16 Yuni Susanti , Nina Holsmoelle

Aspect sentiment quad prediction (ASQP) facilitates a detailed understanding of opinions expressed in a text by identifying the opinion term, aspect term, aspect category and sentiment polarity for each opinion. However, annotating a full…

计算与语言 · 计算机科学 2025-05-30 Nils Constantin Hellwig , Jakob Fehle , Udo Kruschwitz , Christian Wolff

While Large Language Models (LLMs) exhibit remarkable capabilities in zero-shot and few-shot scenarios, they often require computationally prohibitive sizes. Conversely, smaller Masked Language Models (MLMs) like BERT and RoBERTa achieve…

计算与语言 · 计算机科学 2024-10-18 Ahmed Elshabrawy , Yongxin Huang , Iryna Gurevych , Alham Fikri Aji

Finding appropriate prompts for the specific task has become an important issue as the usage of Large Language Models (LLM) has expanded. Reinforcement Learning (RL) is widely used for prompt tuning, but its inherent instability and…

计算与语言 · 计算机科学 2024-10-11 Minchan Kwon , Gaeun Kim , Jongsuk Kim , Haeil Lee , Junmo Kim

Artificial intelligence (AI) is widely deployed to solve problems related to marketing attribution and budget optimization. However, AI models can be quite complex, and it can be difficult to understand model workings and insights without…

计算与语言 · 计算机科学 2024-04-23 Yilin Gao , Sai Kumar Arava , Yancheng Li , James W. Snyder

Large language models (LLMs) seem to offer an easy path to interpretability: just ask them to explain their answers. Yet the features driving an answer often differ from those emphasized in its explanation, meaning post-hoc rationales can…

计算与语言 · 计算机科学 2026-04-14 Sahar Admoni , Ofra Amir , Assaf Hallak , Yftah Ziser

Large audio language models (ALMs) extend LLMs with auditory understanding. A common approach freezes the LLM and trains only an adapter on self-generated targets. However, this fails for reasoning LLMs (RLMs) whose built-in…

计算与语言 · 计算机科学 2026-03-11 Petr Grinberg , Hassan Shahmohammadi

Natural Language Processing (NLP) and Voice Recognition agents are rapidly evolving healthcare by enabling efficient, accessible, and professional patient support while automating grunt work. This report serves as my self project wherein…

音频与语音处理 · 电气工程与系统科学 2025-02-21 Kabir Kumar

Current literature demonstrates that Large Language Models (LLMs) are great few-shot learners, and prompting significantly increases their performance on a range of downstream tasks in a few-shot learning setting. An attempt to automate…

计算与语言 · 计算机科学 2023-06-26 Yulin Zhou , Yiren Zhao , Ilia Shumailov , Robert Mullins , Yarin Gal

Adapting pre-trained text Large Language Models (LLMs) into Speech Language Models (Speech LMs) via continual pretraining on speech data is promising, but often degrades the original text capabilities. We propose Multimodal Depth Upscaling,…

计算与语言 · 计算机科学 2026-04-02 Kazuki Yano , Jun Suzuki , Shinji Watanabe

Small language models (SLMs) are more efficient, cost-effective, and customizable than large language models (LLMs), though they often underperform in specific areas like reasoning. Past methods for enhancing SLMs' reasoning, such as…

计算与语言 · 计算机科学 2024-12-12 Kaiyuan Chen , Jin Wang , Xuejie Zhang

$ $The synergy of language and vision models has given rise to Large Language and Vision Assistant models (LLVAs), designed to engage users in rich conversational experiences intertwined with image-based queries. These comprehensive…

计算机视觉与模式识别 · 计算机科学 2024-01-02 Ashhadul Islam , Md. Rafiul Biswas , Wajdi Zaghouani , Samir Brahim Belhaouari , Zubair Shah

This review surveys the rapid evolution of Meta AI's LLaMA (Large Language Model Meta AI) series - from LLaMA 1 through LLaMA 4 and the specialized parameter-efficient fine-tuning (PEFT) methods developed for these models. We first describe…

Sentence level pronunciation assessment is important for Computer Assisted Language Learning (CALL). Traditional speech pronunciation assessment, based on the Goodness of Pronunciation (GOP) algorithm, has some weakness in assessing a…

音频与语音处理 · 电气工程与系统科学 2020-10-27 Bin Su , Shaoguang Mao , Frank Soong , Yan Xia , Jonathan Tien , Zhiyong Wu

Large Language Models (LLMs) have revolutionized the landscape of machine learning, yet current benchmarks often fall short in capturing the diverse behavior of these models in real-world applications. A benchmark's usefulness is determined…

机器学习 · 计算机科学 2024-08-21 Ravi Raju , Swayambhoo Jain , Bo Li , Jonathan Li , Urmish Thakker

The growing population of L2 English speakers has increased the demand for developing automatic graders for spoken language assessment (SLA). Historically, statistical models, text encoders, and self-supervised speech models have been…

计算与语言 · 计算机科学 2025-05-28 Rao Ma , Mengjie Qian , Siyuan Tang , Stefano Bannò , Kate M. Knill , Mark J. F. Gales

Small Language Models (SLMs) offer compelling advantages in deployment cost and latency, but their accuracy often lags behind larger models, particularly for complex domain-specific tasks. While supervised fine-tuning can help bridge this…

Compared to other clinical screening techniques, speech-and-language-based automated Alzheimer's disease (AD) detection methods are characterized by their non-invasiveness, cost-effectiveness, and convenience. Previous studies have…

音频与语音处理 · 电气工程与系统科学 2024-12-10 Yin-Long Liu , Rui Feng , Jia-Hong Yuan , Zhen-Hua Ling