中文
相关论文

相关论文: Fine-Tuning Large Multimodal Models for Automatic …

200 篇论文

The rapid progress of large language models (LLMs) has transformed natural language processing, yet the challenge of efficient adaptation remains unresolved. Full fine-tuning achieves strong performance but imposes prohibitive computational…

量子物理 · 物理学 2025-09-23 Emily Jimin Roh , Hyojun Ahn , Samuel Yen-Chi Chen , Soohyun Park , Joongheon Kim

Large language models (LLMs) are increasingly used in clinical and care settings. This exploratory study investigates whether LLMs exhibit sycophantic behavior - adapting their responses to social expectation signals rather than maintaining…

计算机与社会 · 计算机科学 2026-05-19 Christian Kolb

Connecting audio encoders with large language models (LLMs) allows the LLM to perform various audio understanding tasks, such as automatic speech recognition (ASR) and audio captioning (AC). Most research focuses on training an adapter…

音频与语音处理 · 电气工程与系统科学 2025-09-22 Weiqiao Shan , Yuang Li , Yuhao Zhang , Yingfeng Luo , Chen Xu , Xiaofeng Zhao , Long Meng , Yunfei Lu , Min Zhang , Hao Yang , Tong Xiao , Jingbo Zhu

Pre-trained large-scale language models (LLMs) excel at producing coherent articles, yet their outputs may be untruthful, toxic, or fail to align with user expectations. Current approaches focus on using reinforcement learning with human…

计算与语言 · 计算机科学 2024-06-06 Dehong Xu , Liang Qiu , Minseok Kim , Faisal Ladhak , Jaeyoung Do

Although large language models (LLMs) have achieved remarkable performance across various tasks, they remain prone to errors. A key challenge is enabling them to self-correct. While prior research has relied on external tools or large…

计算与语言 · 计算机科学 2025-03-12 Viktor Moskvoretskii , Chris Biemann , Irina Nikishina

In interactions between users and language model agents, user utterances frequently exhibit ellipsis (omission of words or phrases) or imprecision (lack of exactness) to prioritize efficiency. This can lead to varying interpretations of the…

计算与语言 · 计算机科学 2024-10-07 Hyuhng Joon Kim , Youna Kim , Cheonbok Park , Junyeob Kim , Choonghyun Park , Kang Min Yoo , Sang-goo Lee , Taeuk Kim

Large Language Models (LLMs) are increasingly deployed in roles requiring nuanced psychological understanding, such as emotional support agents, counselors, and decision-making assistants. However, their ability to interpret human…

计算与语言 · 计算机科学 2025-09-17 Jianfeng Zhu , Julina Maharjan , Xinyu Li , Karin G. Coifman , Ruoming Jin

Though Large Language Models (LLMs) have demonstrated the powerful capabilities of few-shot learning through prompting methods, supervised training is still necessary for complex reasoning tasks. Because of their extensive parameters and…

计算与语言 · 计算机科学 2024-06-07 Linhai Zhang , Jialong Wu , Deyu Zhou , Guoqiang Xu

Large language models (LLMs) face a fundamental trade-off between computational efficiency (e.g., number of parameters) and output quality, especially when deployed on computationally limited devices such as phones or laptops. One way to…

The advancement of Large Language Models (LLMs) for domain applications in fields such as materials science and engineering depends on the development of fine-tuning strategies that adapt models for specialized, technical capabilities. In…

计算与语言 · 计算机科学 2024-09-06 Wei Lu , Rachel K. Luu , Markus J. Buehler

Large pre-trained language models (LMs) such as GPT-3 have acquired a surprising ability to perform zero-shot learning. For example, to classify sentiment without any training examples, we can "prompt" the LM with the review and the label…

计算与语言 · 计算机科学 2021-09-09 Ruiqi Zhong , Kristy Lee , Zheng Zhang , Dan Klein

Large Language Models (LLMs) have achieved excellent performances in various tasks. However, fine-tuning an LLM requires extensive supervision. Human, on the other hand, may improve their reasoning abilities by self-thinking without…

计算与语言 · 计算机科学 2022-10-26 Jiaxin Huang , Shixiang Shane Gu , Le Hou , Yuexin Wu , Xuezhi Wang , Hongkun Yu , Jiawei Han

Regression learning is classic and fundamental for medical image analysis. It provides the continuous mapping for many critical applications, like the attribute estimation, object detection, segmentation and non-rigid registration. However,…

计算机视觉与模式识别 · 计算机科学 2022-07-04 Chaoyu Chen , Xin Yang , Ruobing Huang , Xindi Hu , Yankai Huang , Xiduo Lu , Xinrui Zhou , Mingyuan Luo , Yinyu Ye , Xue Shuang , Juzheng Miao , Yi Xiong , Dong Ni

We propose to utilize an instruction-tuned large language model (LLM) for guiding the text generation process in automatic speech recognition (ASR). Modern large language models (LLMs) are adept at performing various text generation tasks…

音频与语音处理 · 电气工程与系统科学 2025-01-08 Yosuke Higuchi , Tetsuji Ogawa , Tetsunori Kobayashi

Large audio-language models (LALMs) exhibit strong zero-shot capabilities in multiple downstream tasks, such as audio question answering (AQA) and abstract reasoning; however, these models still lag behind specialized models for certain…

声音 · 计算机科学 2026-03-24 Videet Mehta , Liming Wang , Hilde Kuehne , Rogerio Feris , James R. Glass , M. Jehanzeb Mirza

Building high-quality datasets and labeling query-document relevance are essential yet resource-intensive tasks, requiring detailed guidelines and substantial effort from human annotators. This paper explores the use of small, fine-tuned…

信息检索 · 计算机科学 2025-04-15 Quentin Fitte-Rey , Matyas Amrouche , Romain Deveaud

Large Language Models (LLMs) exhibit a significant "embodiment gap", where their text-based representations fail to align with human sensorimotor experiences. This study systematically investigates whether and how task-specific fine-tuning…

计算与语言 · 计算机科学 2026-03-05 Minghua Wu , Javier Conde , Pedro Reviriego , Marc Brysbaert

The machine learning community has witnessed impressive advancements since large language models (LLMs) first appeared. Yet, their massive memory consumption has become a significant roadblock to large-scale training. For instance, a 7B…

机器学习 · 计算机科学 2024-12-30 Rui Pan , Xiang Liu , Shizhe Diao , Renjie Pi , Jipeng Zhang , Chi Han , Tong Zhang

Large Language Models are expressive tools that enable complex tasks of text understanding within Computational Social Science. Their versatility, while beneficial, poses a barrier for establishing standardized best practices within the…

计算机与社会 · 计算机科学 2024-08-05 Anders Giovanni Møller , Luca Maria Aiello

Customer feedback is invaluable to companies as they refine their products. Monitoring customer feedback can be automated with Aspect Level Sentiment Classification (ALSC) which allows us to analyse specific aspects of the products in…

计算与语言 · 计算机科学 2023-07-13 Dhruv Mullick , Bilal Ghanem , Alona Fyshe