中文
相关论文

相关论文: From Pixels to Prose: Advancing Multi-Modal Langua…

200 篇论文

The revolutionary capabilities of large language models (LLMs) have paved the way for multimodal large language models (MLLMs) and fostered diverse applications across various specialized domains. In the remote sensing (RS) field, however,…

计算机视觉与模式识别 · 计算机科学 2024-07-17 Dilxat Muhtar , Zhenshi Li , Feng Gu , Xueliang Zhang , Pengfeng Xiao

This survey and application guide to multimodal large language models(MLLMs) explores the rapidly developing field of MLLMs, examining their architectures, applications, and impact on AI and Generative Models. Starting with foundational…

人工智能 · 计算机科学 2025-12-02 Chia Xin Liang , Pu Tian , Caitlyn Heqi Yin , Yao Yua , Wei An-Hou , Li Ming , Xinyuan Song , Tianyang Wang , Ziqian Bi , Ming Liu

Multimodal large language models (MLLMs) have altered the landscape of computer vision, obtaining impressive results across a wide range of tasks, especially in zero-shot settings. Unfortunately, their strong performance does not always…

计算机视觉与模式识别 · 计算机科学 2025-04-16 Darryl Hannan , John Cooper , Dylan White , Timothy Doster , Henry Kvinge , Yijing Watkins

This study aims to comprehensively review and empirically evaluate the application of multimodal large language models (MLLMs) and Large Vision Models (VLMs) in object detection for transportation systems. In the first fold, we provide a…

计算机视觉与模式识别 · 计算机科学 2024-09-30 Huthaifa I. Ashqar , Ahmed Jaber , Taqwa I. Alhadidi , Mohammed Elhenawy

Multimodal large language models (MLLMs) enhance the capabilities of standard large language models by integrating and processing data from multiple modalities, including text, vision, audio, video, and 3D environments. Data plays a pivotal…

In recent years, large language models have had a very impressive performance, which largely contributed to the development and application of artificial intelligence, and the parameters and performance of the models are still growing…

机器学习 · 计算机科学 2025-01-10 Xuran Zheng , Chang D. Yoo

Automatically and rapidly understanding Earth's surface is fundamental to our grasp of the living environment and informed decision-making. This underscores the need for a unified system with comprehensive capabilities in analyzing Earth's…

计算机视觉与模式识别 · 计算机科学 2024-11-15 Zhenshi Li , Dilxat Muhtar , Feng Gu , Xueliang Zhang , Pengfeng Xiao , Guangjun He , Xiaoxiang Zhu

Large Language Models (LLMs) represent a class of deep learning models adept at understanding natural language and generating coherent responses to various prompts or queries. These models far exceed the complexity of conventional neural…

机器学习 · 计算机科学 2024-12-05 Minghao Shao , Abdul Basit , Ramesh Karri , Muhammad Shafique

Connecting text and visual modalities plays an essential role in generative intelligence. For this reason, inspired by the success of large language models, significant research efforts are being devoted to the development of Multimodal…

Multimodal fusion of remote sensing images serves as a core technology for overcoming the limitations of single-source data and improving the accuracy of surface information extraction, which exhibits significant application value in fields…

计算机视觉与模式识别 · 计算机科学 2026-01-12 Siyu Zhang , Lianlei Shan , Runhe Qiu

With the significant advancements of Large Language Models (LLMs) in the field of Natural Language Processing (NLP), the development of image-text multimodal models has garnered widespread attention. Current surveys on image-text multimodal…

计算与语言 · 计算机科学 2024-06-21 Ruifeng Guo , Jingxuan Wei , Linzhuang Sun , Bihui Yu , Guiyong Chang , Dawei Liu , Sibo Zhang , Zhengbing Yao , Mingjun Xu , Liping Bu

The Multi-Modal Large Language Model (MLLM) refers to an extension of the Large Language Model (LLM) equipped with the capability to receive and infer multi-modal data. Spatial awareness stands as one of the crucial abilities of MLLM,…

人工智能 · 计算机科学 2023-11-02 Yongqiang Zhao , Zhenyu Li , Zhi Jin , Feng Zhang , Haiyan Zhao , Chengfeng Dou , Zhengwei Tao , Xinhai Xu , Donghong Liu

Following the recent popularity of Large Language Models (LLMs), several attempts have been made to extend them to the visual domain. From having a visual assistant that could guide us through unfamiliar environments to generative models…

This work presents a comparative evaluation of machine translation systems applied to images containing textual information, a task that lies at the intersection of computer vision and natural language processing. The study compares three…

计算与语言 · 计算机科学 2026-05-29 Blai Puchol , Sergio Gómez González , Miguel Domingo , Francisco Casacuberta

Recently, large language models (LLMs) and vision-language models (VLMs) have achieved significant success, demonstrating remarkable capabilities in understanding various images and videos, particularly in classification and detection…

计算机视觉与模式识别 · 计算机科学 2025-03-21 Fei Wang , Chengcheng Chen , Hongyu Chen , Yugang Chang , Weiming Zeng

The rapid development of Large Language Models (LLMs) demonstrates remarkable multilingual capabilities in natural language processing, attracting global attention in both academia and industry. To mitigate potential discrimination and…

The rapid development of Artificial Intelligence (AI) has revolutionized numerous fields, with large language models (LLMs) and computer vision (CV) systems driving advancements in natural language understanding and visual processing,…

Large Vision and Language Models (LVLMs) have shown strong performance across various vision-language tasks in natural image domains. However, their application to remote sensing (RS) remains underexplored due to significant domain…

计算机视觉与模式识别 · 计算机科学 2025-06-30 Sungjune Park , Yeongyun Kim , Se Yeon Kim , Yong Man Ro

The rapid progress in Multimodal Large Language Models (MLLMs) has significantly advanced their ability to process and understand complex visual and textual information. However, the integration of multiple images and extensive textual…

计算机视觉与模式识别 · 计算机科学 2024-08-27 Yujie Lu , Xiujun Li , Tsu-Jui Fu , Miguel Eckstein , William Yang Wang

With the rapid advancement of Multimodal Large Language Models (MLLMs), a variety of benchmarks have been introduced to evaluate their capabilities. While most evaluations have focused on complex tasks such as scientific comprehension and…

计算机视觉与模式识别 · 计算机科学 2024-12-24 Huan Liu , Lingyu Xiao , Jiangjiang Liu , Xiaofan Li , Ze Feng , Sen Yang , Jingdong Wang