English
Related papers

Related papers: Visual Prompting in Multimodal Large Language Mode…

200 papers

Although Multimodal Large Language Models (MLLMs) have demonstrated promising versatile capabilities, their performance is still inferior to specialized models on downstream tasks, which makes adaptation necessary to enhance their utility.…

Computer Vision and Pattern Recognition · Computer Science 2024-04-18 Yichi Zhang , Yinpeng Dong , Siyuan Zhang , Tianzan Min , Hang Su , Jun Zhu

The recent trend in the Large Vision and Language model has brought a new change in how information extraction systems are built. VLMs have set a new benchmark with their State-of-the-art techniques in understanding documents and building…

Computer Vision and Pattern Recognition · Computer Science 2024-08-08 Dipankar Medhi

Low-shot image classification, where training images are limited or inaccessible, has benefited from recent progress on pre-trained vision-language (VL) models with strong generalizability, e.g. CLIP. Prompt learning methods built with VL…

Computer Vision and Pattern Recognition · Computer Science 2024-04-04 Zhaoheng Zheng , Jingmin Wei , Xuefeng Hu , Haidong Zhu , Ram Nevatia

Prompt engineering is a technique that involves augmenting a large pre-trained model with task-specific hints, known as prompts, to adapt the model to new tasks. Prompts can be created manually as natural language instructions or generated…

Computer Vision and Pattern Recognition · Computer Science 2023-07-25 Jindong Gu , Zhen Han , Shuo Chen , Ahmad Beirami , Bailan He , Gengyuan Zhang , Ruotong Liao , Yao Qin , Volker Tresp , Philip Torr

This survey and application guide to multimodal large language models(MLLMs) explores the rapidly developing field of MLLMs, examining their architectures, applications, and impact on AI and Generative Models. Starting with foundational…

Artificial Intelligence · Computer Science 2025-12-02 Chia Xin Liang , Pu Tian , Caitlyn Heqi Yin , Yao Yua , Wei An-Hou , Li Ming , Xinyuan Song , Tianyang Wang , Ziqian Bi , Ming Liu

Since the resurgence of deep learning, vision-language models (VLMs) enhanced by large language models (LLMs) have grown exponentially in popularity. However, while LLMs can utilize extensive background knowledge and task information with…

Computation and Language · Computer Science 2024-03-21 Haozhe Zhao , Zefan Cai , Shuzheng Si , Xiaojian Ma , Kaikai An , Liang Chen , Zixuan Liu , Sheng Wang , Wenjuan Han , Baobao Chang

Having revolutionized natural language processing (NLP) applications, large language models (LLMs) are expanding into the realm of multimodal inputs. Owing to their ability to interpret images, multimodal LLMs (MLLMs) have been primarily…

Computer Vision and Pattern Recognition · Computer Science 2024-02-14 Jusung Lee , Sungguk Cha , Younghyun Lee , Cheoljong Yang

Multimodal large language models (MLLMs) have shown great potential in perception and interpretation tasks, but their capabilities in predictive reasoning remain under-explored. To address this gap, we introduce a novel benchmark that…

Computer Vision and Pattern Recognition · Computer Science 2023-10-23 Mingwei Zhu , Leigang Sha , Yu Shu , Kangjia Zhao , Tiancheng Zhao , Jianwei Yin

Multimodal large language models (MLLMs) enhance the capabilities of standard large language models by integrating and processing data from multiple modalities, including text, vision, audio, video, and 3D environments. Data plays a pivotal…

Artificial Intelligence · Computer Science 2024-07-19 Tianyi Bai , Hao Liang , Binwang Wan , Yanran Xu , Xi Li , Shiyu Li , Ling Yang , Bozhou Li , Yifan Wang , Bin Cui , Ping Huang , Jiulong Shan , Conghui He , Binhang Yuan , Wentao Zhang

Recently, Multimodal Large Language Models (MLLMs) that enable Large Language Models (LLMs) to interpret images through visual instruction tuning have achieved significant success. However, existing visual instruction tuning methods only…

Computer Vision and Pattern Recognition · Computer Science 2023-09-15 Chi Chen , Ruoyu Qin , Fuwen Luo , Xiaoyue Mi , Peng Li , Maosong Sun , Yang Liu

Large Language Models (LLMs) represent a class of deep learning models adept at understanding natural language and generating coherent responses to various prompts or queries. These models far exceed the complexity of conventional neural…

Machine Learning · Computer Science 2024-12-05 Minghao Shao , Abdul Basit , Ramesh Karri , Muhammad Shafique

Autoregressive Large Language Models have transformed the landscape of Natural Language Processing. Pre-train and prompt paradigm has replaced the conventional approach of pre-training and fine-tuning for many downstream NLP tasks. This…

Computation and Language · Computer Science 2024-04-18 Prabin Bhandari

Visual-language pre-training has achieved remarkable success in many multi-modal tasks, largely attributed to the availability of large-scale image-text datasets. In this work, we demonstrate that Multi-modal Large Language Models (MLLMs)…

Computer Vision and Pattern Recognition · Computer Science 2024-03-14 Yanqing Liu , Kai Wang , Wenqi Shao , Ping Luo , Yu Qiao , Mike Zheng Shou , Kaipeng Zhang , Yang You

Large language models (LLMs) have exhibited impressive abilities for multimodal content comprehension and reasoning with proper prompting in zero- or few-shot settings. Despite the proliferation of interactive systems developed to support…

Human-Computer Interaction · Computer Science 2024-10-01 Jianben He , Xingbo Wang , Shiyi Liu , Guande Wu , Claudio Silva , Huamin Qu

The advent of Large Language Models (LLMs) has significantly reshaped the trajectory of the AI revolution. Nevertheless, these LLMs exhibit a notable limitation, as they are primarily adept at processing textual information. To address this…

Computer Vision and Pattern Recognition · Computer Science 2025-10-15 Akash Ghosh , Arkadeep Acharya , Sriparna Saha , Vinija Jain , Aman Chadha

Recent developments in video translation have further enhanced cross-lingual access to video content, with multimodal large language models (MLLMs) playing an increasingly important supporting role. With strong multimodal understanding,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Bingzheng QU , Kehai Chen , Xuefeng Bai , Min Zhang

Recent multimodal large language models (MLLMs) have shown promising instruction following capabilities on vision-language tasks. In this work, we introduce VISUAL MODALITY INSTRUCTION (VIM), and investigate how well multimodal models can…

Computer Vision and Pattern Recognition · Computer Science 2024-06-12 Xiujun Li , Yujie Lu , Zhe Gan , Jianfeng Gao , William Yang Wang , Yejin Choi

The Multimodal Large Language Models (MLLMs) have activated the capabilitiesof Large Language Models (LLMs) in solving visual-language tasks by integratingvisual information. The prevailing approach in existing MLLMs involvesemploying an…

Computer Vision and Pattern Recognition · Computer Science 2024-10-31 Tianxiang Wu , Minxin Nie , Ziqiang Cao

Large Vision-Language Models (VLMs) are increasingly being regarded as foundation models that can be instructed to solve diverse tasks by prompting, without task-specific training. We examine the seemingly obvious question: how to…

Computer Vision and Pattern Recognition · Computer Science 2026-02-09 Niccolo Avogaro , Thomas Frick , Mattia Rigotti , Andrea Bartezzaghi , Filip Janicki , Cristiano Malossi , Konrad Schindler , Roy Assaf

We empirically investigate proper pre-training methods to build good visual tokenizers, making Large Language Models (LLMs) powerful Multimodal Large Language Models (MLLMs). In our benchmark, which is curated to evaluate MLLMs visual…

Computer Vision and Pattern Recognition · Computer Science 2023-05-24 Guangzhi Wang , Yixiao Ge , Xiaohan Ding , Mohan Kankanhalli , Ying Shan