English
Related papers

Related papers: NExT-GPT: Any-to-Any Multimodal LLM

200 papers

Natural language processing (NLP) is a key component of intelligent transportation systems (ITS), but it faces many challenges in the transportation domain, such as domain-specific knowledge and data, and multi-modal inputs and outputs.…

Computation and Language · Computer Science 2024-02-13 Peng Wang , Xiang Wei , Fangxu Hu , Wenjuan Han

Conversation agents fueled by Large Language Models (LLMs) are providing a new way to interact with visual data. While there have been initial attempts for image-based conversation models, this work addresses the under-explored field of…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Muhammad Maaz , Hanoona Rasheed , Salman Khan , Fahad Shahbaz Khan

The rapid advancement of Large Language Models (LLMs) has revolutionized various sectors by automating routine tasks, marking a step toward the realization of Artificial General Intelligence (AGI). However, they still struggle to…

Machine Learning · Computer Science 2024-02-21 Zihao Tang , Zheqi Lv , Shengyu Zhang , Fei Wu , Kun Kuang

Multimodal large language models (MLLMs) have gained significant attention due to their strong multimodal understanding capability. However, existing works rely heavily on modality-specific encoders, which usually differ in architecture and…

Computer Vision and Pattern Recognition · Computer Science 2025-01-10 Jiaming Han , Kaixiong Gong , Yiyuan Zhang , Jiaqi Wang , Kaipeng Zhang , Dahua Lin , Yu Qiao , Peng Gao , Xiangyu Yue

Large language models (LLMs) with billions of parameters and pretrained on massive amounts of data are now capable of near or better than state-of-the-art performance in a variety of downstream natural language processing tasks. Neural…

Computation and Language · Computer Science 2024-07-08 Victor Agostinelli , Max Wild , Matthew Raffel , Kazi Ahmed Asif Fuad , Lizhong Chen

Multimodal Large Language Models (MLLMs) mimic human perception and reasoning system by integrating powerful Large Language Models (LLMs) with various modality encoders (e.g., vision, audio), positioning LLMs as the "brain" and various…

Computer Vision and Pattern Recognition · Computer Science 2024-08-29 Jiaxing Huang , Jingyi Zhang

World models are progressively being employed across diverse fields, extending from basic environment simulation to complex scenario construction. However, existing models are mainly trained on domain-specific states and actions, and…

Artificial Intelligence · Computer Science 2024-10-01 Zhiqi Ge , Hongzhe Huang , Mingze Zhou , Juncheng Li , Guoming Wang , Siliang Tang , Yueting Zhuang

By integrating the perception capabilities of multimodal encoders with the generative power of Large Language Models (LLMs), Multimodal Large Language Models (MLLMs), exemplified by GPT-4V, have achieved great success in various multimodal…

Computer Vision and Pattern Recognition · Computer Science 2025-08-18 Wenbin An , Jiahao Nie , Yaqiang Wu , Feng Tian , Shijian Lu , Qinghua Zheng

Large Language Models (LLMs) possess human-level cognitive and decision-making capabilities, making them a key technology for 6G. However, applying LLMs to the communication domain faces three major challenges: 1) Inadequate communication…

Information Theory · Computer Science 2025-02-27 Feibo Jiang , Wanyun Zhu , Li Dong , Kezhi Wang , Kun Yang , Cunhua Pan , Octavia A. Dobre

We present M2-omni, a cutting-edge, open-source omni-MLLM that achieves competitive performance to GPT-4o. M2-omni employs a unified multimodal sequence modeling framework, which empowers Large Language Models(LLMs) to acquire comprehensive…

With the emergence of large language models (LLMs) and vision foundation models, how to combine the intelligence and capacity of these open-sourced or API-available models to achieve open-world visual perception remains an open question. In…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Chris Kelly , Luhui Hu , Bang Yang , Yu Tian , Deshun Yang , Cindy Yang , Zaoshan Huang , Zihao Li , Jiayin Hu , Yuexian Zou

We present a vision and language model named MultiModal-GPT to conduct multi-round dialogue with humans. MultiModal-GPT can follow various instructions from humans, such as generating a detailed caption, counting the number of interested…

Computer Vision and Pattern Recognition · Computer Science 2023-06-14 Tao Gong , Chengqi Lyu , Shilong Zhang , Yudong Wang , Miao Zheng , Qian Zhao , Kuikun Liu , Wenwei Zhang , Ping Luo , Kai Chen

AI tasks encompass a wide range of domains and fields. While numerous AI models have been designed for specific tasks and applications, they often require considerable human efforts in finding the right model architecture, optimization…

Computation and Language · Computer Science 2023-05-05 Shujian Zhang , Chengyue Gong , Lemeng Wu , Xingchao Liu , Mingyuan Zhou

The integration of large language models (LLMs) with vision-language (VL) tasks has been a transformative development in the realm of artificial intelligence, highlighting the potential of LLMs as a versatile general-purpose chatbot.…

Computer Vision and Pattern Recognition · Computer Science 2024-07-26 Vedanshu , MM Tripathi , Bhavnesh Jaint

Instruction-tuned large language models (LLMs) have demonstrated promising zero-shot generalization capabilities across various downstream tasks. Recent research has introduced multimodal capabilities to LLMs by integrating independently…

Computation and Language · Computer Science 2023-11-29 Utsav Garg , Erhan Bas

Multimodal large language models (MLLMs) have emerged as a prominent area of interest within the research community, given their proficiency in handling and reasoning with non-textual data, including images and videos. This study seeks to…

Computer Vision and Pattern Recognition · Computer Science 2024-11-12 Zhenhua Xu , Yujia Zhang , Enze Xie , Zhen Zhao , Yong Guo , Kwan-Yee. K. Wong , Zhenguo Li , Hengshuang Zhao

Large language models (LLMs), such as ChatGPT/GPT-4, have proven to be powerful tools in promoting the user experience as an AI assistant. The continuous works are proposing multi-modal large language models (MLLM), empowering LLMs with the…

Computation and Language · Computer Science 2023-10-23 Ziqiang Zheng , Jipeng Zhang , Tuan-Anh Vu , Shizhe Diao , Yue Him Wong Tim , Sai-Kit Yeung

Large Language Models(LLMs) have shown remarkable emergent abilities in unifying almost all (if not every) NLP tasks. In the human motion-related realm, however, researchers still develop siloed models for each task. Inspired by InstuctGPT,…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Zixiang Zhou , Yu Wan , Baoyuan Wang

For centuries, researchers have sought out ways to connect disparate areas of knowledge. While early scholars (Galileo, da Vinci, etc.) were experts across fields, specialization has taken hold later. With the advent of Artificial…

Computation and Language · Computer Science 2023-10-17 Markus J. Buehler

The success of large language models (LLMs) has inspired an emerging research field of multimodal learning. However, a grand challenge of exploiting LLMs for multimodal learning is the size of pre-trained LLMs which are always with billions…

Computation and Language · Computer Science 2024-04-08 Zhengqing Yuan , Yunhong He , Kun Wang , Yanfang Ye , Lichao Sun