English
Related papers

Related papers: Language Integration in Fine-Tuning Multimodal Lar…

200 papers

Recent multi-modal large language models (MLLMs) often struggle to generate personalized image captions, even when trained on high-quality captions. In this work, we observe that such limitations persist in existing post-training-based MLLM…

Computer Vision and Pattern Recognition · Computer Science 2025-10-13 Yeongtak Oh , Dohyun Chung , Juhyeon Shin , Sangha Park , Johan Barthelemy , Jisoo Mok , Sungroh Yoon

Automatic text classification (ATC) has experienced remarkable advancements in the past decade, best exemplified by recent small and large language models (SLMs and LLMs), leveraged by Transformer architectures. Despite recent effectiveness…

Computation and Language · Computer Science 2025-04-03 Washington Cunha , Leonardo Rocha , Marcos André Gonçalves

Reranking is fundamental to information retrieval and retrieval-augmented generation, with recent Large Language Models (LLMs) significantly advancing reranking quality. Most current works rely on large-scale LLMs (>7B parameters),…

Information Retrieval · Computer Science 2026-04-17 Xianming Li , Aamir Shakir , Rui Huang , Tsz-fung Andrew Lee , Julius Lipp , Benjamin Clavié , Jing Li

Multi-modal large language models (MLLMs), such as GPT-4o, excel at integrating text and visual data but face systematic challenges when interpreting ambiguous or incomplete visual stimuli. This study leverages statistical modeling to…

Machine Learning · Computer Science 2024-12-09 Ching-Yi Wang

This study investigates the adoption of open-access, locally deployable causal large language models (LLMs) for travel mode choice prediction and introduces LiTransMC, the first fine-tuned causal LLM developed for this task. We…

Computation and Language · Computer Science 2025-10-08 Tareq Alsaleh , Bilal Farooq

Multimodal Large Language Models (MLLM) classification performance depends critically on evaluation protocol and ground truth quality. Studies comparing MLLMs with supervised and vision-language models report conflicting conclusions, and we…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Nikita Kisel , Illia Volkov , Klara Janouskova , Jiri Matas

With the rapid advancement of Multimodal Large Language Models (MLLMs), a variety of benchmarks have been introduced to evaluate their capabilities. While most evaluations have focused on complex tasks such as scientific comprehension and…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Huan Liu , Lingyu Xiao , Jiangjiang Liu , Xiaofan Li , Ze Feng , Sen Yang , Jingdong Wang

While Large Multimodal Models (LMMs) have made significant progress, they remain largely text-centric, relying on language as their core reasoning modality. As a result, they are limited in their ability to handle reasoning tasks that are…

Computer Vision and Pattern Recognition · Computer Science 2025-12-25 Kelvin Li , Chuyi Shang , Leonid Karlinsky , Rogerio Feris , Trevor Darrell , Roei Herzig

Vision and Language Models (VLMs), such as CLIP, have enabled visual recognition of a potentially unlimited set of categories described by text prompts. However, for the best visual recognition performance, these models still require tuning…

Computer Vision and Pattern Recognition · Computer Science 2023-09-14 M. Jehanzeb Mirza , Leonid Karlinsky , Wei Lin , Horst Possegger , Rogerio Feris , Horst Bischof

Vision-language foundation models (VLMs) have shown great potential in feature transfer and generalization across a wide spectrum of medical-related downstream tasks. However, fine-tuning these models is resource-intensive due to their…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Ye Du , Nanxi Yu , Shujun Wang

Large Language Models (LLMs) have strong instruction-following capability to interpret and execute tasks as directed by human commands. Multimodal Large Language Models (MLLMs) have inferior instruction-following ability compared to LLMs.…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Te Yang , Jian Jia , Xiangyu Zhu , Weisong Zhao , Bo Wang , Yanhua Cheng , Yan Li , Shengyuan Liu , Quan Chen , Peng Jiang , Kun Gai , Zhen Lei

Large language models (LLMs) have emerged as powerful general-purpose interfaces for many machine learning problems. Recent work has adapted LLMs to generative visual tasks like image captioning, visual question answering, and visual chat,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-28 Piotr Teterwak , Ximeng Sun , Bryan A. Plummer , Kate Saenko , Ser-Nam Lim

Large Language Models (LLMs) have gained widespread popularity due to their ability to perform ad-hoc Natural Language Processing (NLP) tasks with a simple natural language prompt. Part of the appeal for LLMs is their approachability to the…

Human-Computer Interaction · Computer Science 2025-02-25 Aditi Mishra , Utkarsh Soni , Anjana Arunkumar , Jinbin Huang , Bum Chul Kwon , Chris Bryan

Recent Multimodal Large Language Models (MLLMs) excel on benchmark vision-language tasks, yet little is known about how input visual quality shapes their responses. Does higher perceptual quality of images already translate to better MLLM…

Computer Vision and Pattern Recognition · Computer Science 2025-06-19 Shuo Xing , Lanqing Guo , Hongyuan Hua , Seoyoung Lee , Peiran Li , Yufei Wang , Zhangyang Wang , Zhengzhong Tu

We investigate fine-tuning Vision-Language Models (VLMs) for multi-task medical image understanding, focusing on detection, localization, and counting of findings in medical images. Our objective is to evaluate whether instruction-tuned…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Sushant Gautam , Michael A. Riegler , Pål Halvorsen

Low-shot image classification, where training images are limited or inaccessible, has benefited from recent progress on pre-trained vision-language (VL) models with strong generalizability, e.g. CLIP. Prompt learning methods built with VL…

Computer Vision and Pattern Recognition · Computer Science 2024-04-04 Zhaoheng Zheng , Jingmin Wei , Xuefeng Hu , Haidong Zhu , Ram Nevatia

The success of Large Language Models (LLMs) has led to a parallel rise in the development of Large Multimodal Models (LMMs), which have begun to transform a variety of applications. These sophisticated multimodal models are designed to…

Artificial Intelligence · Computer Science 2025-05-20 Fouad Trad , Ali Chehab

Vision-language models (VLMs) pre-trained on web-scale datasets have demonstrated remarkable capabilities on downstream tasks when fine-tuned with minimal data. However, many VLMs rely on proprietary data and are not open-source, which…

Computation and Language · Computer Science 2024-05-15 Shihong Liu , Zhiqiu Lin , Samuel Yu , Ryan Lee , Tiffany Ling , Deepak Pathak , Deva Ramanan

Well-designed prompts can guide text-to-image models to generate amazing images. However, the performant prompts are often model-specific and misaligned with user input. Instead of laborious human engineering, we propose prompt adaptation,…

Computation and Language · Computer Science 2024-01-01 Yaru Hao , Zewen Chi , Li Dong , Furu Wei

In the realm of Sign Language Translation (SLT), reliance on costly gloss-annotated datasets has posed a significant barrier. Recent advancements in gloss-free SLT methods have shown promise, yet they often largely lag behind gloss-based…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Han Liang , Chengyu Huang , Yuecheng Xu , Cheng Tang , Weicai Ye , Juze Zhang , Xin Chen , Jingyi Yu , Lan Xu