English
Related papers

Related papers: FaceLLM: A Multimodal Large Language Model for Fac…

200 papers

Since the release of ChatGPT, the field of Natural Language Processing has experienced rapid advancements, particularly in Large Language Models (LLMs) and their multimodal counterparts, Large Multimodal Models (LMMs). Despite their…

Computation and Language · Computer Science 2024-08-27 Florian Schneider , Sunayana Sitaram

The growth of social media, characterized by its multimodal nature, has led to the emergence of diverse phenomena and challenges, which calls for an effective approach to uniformly solve automated tasks. The powerful Large Vision Language…

Computation and Language · Computer Science 2024-10-11 Xinnong Zhang , Haoyu Kuang , Xinyi Mou , Hanjia Lyu , Kun Wu , Siming Chen , Jiebo Luo , Xuanjing Huang , Zhongyu Wei

Recently, Multimodal Large Language Models (MLLMs) have achieved exceptional performance across diverse tasks, continually surpassing previous expectations regarding their capabilities. Nevertheless, their proficiency in perceiving emotions…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Daiqing Wu , Dongbao Yang , Sicheng Zhao , Can Ma , Yu Zhou

Large Language Models (LLMs), such as ChatGPT, LLaMA, GLM, and PaLM, have exhibited remarkable performances across various tasks in recent years. However, LLMs face two main challenges in real-world applications. One challenge is that…

Machine Learning · Computer Science 2023-10-17 Tao Fan , Yan Kang , Guoqiang Ma , Weijing Chen , Wenbin Wei , Lixin Fan , Qiang Yang

The development of Large Vision-Language Models (LVLMs) is striving to catch up with the success of Large Language Models (LLMs), yet it faces more challenges to be resolved. Very recent works enable LVLMs to localize object-level visual…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 Zhipeng Huang , Zhizheng Zhang , Zheng-Jun Zha , Yan Lu , Baining Guo

Large language models (LLMs) have rapidly evolved from general-purpose systems to multimodal models capable of processing text, images, and audio. As both general-purpose LLMs (GLLMs) and multimodal LLMs (MLLMs) gain widespread adoption,…

Software Engineering · Computer Science 2026-04-08 Yujian Liu , Xiao Yu , Jacky Keung , Xing Hu , Xin Xia , Xiaoxue Ma

This paper provides a comprehensive survey of the latest research on multilingual large language models (MLLMs). MLLMs not only are able to understand and generate language across linguistic boundaries, but also represent an important…

Computation and Language · Computer Science 2024-11-20 Shaolin Zhu , Supryadi , Shaoyang Xu , Haoran Sun , Leiyu Pan , Menglong Cui , Jiangcun Du , Renren Jin , António Branco , Deyi Xiong

Multimodal LLMs (MLLMs) are capable of performing complex data analysis, visual question answering, generation, and reasoning tasks. However, their ability to analyze biometric data is relatively underexplored. In this work, we investigate…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Ekta Gavas , Sudipta Banerjee , Chinmay Hegde , Nasir Memon

Solving complicated AI tasks with different domains and modalities is a key step toward artificial general intelligence. While there are numerous AI models available for various domains and modalities, they cannot handle complicated AI…

Computation and Language · Computer Science 2023-12-05 Yongliang Shen , Kaitao Song , Xu Tan , Dongsheng Li , Weiming Lu , Yueting Zhuang

Large Language Models (LLMs) are advanced deep-learning models designed to understand and generate human language. They work together with models that process data like images, enabling cross-modal understanding. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2025-02-25 Shreya Singh

Multimodal Large Language Models (MLLMs) inherit the superior text understanding capabilities of LLMs and extend these capabilities to multimodal scenarios. These models achieve excellent results in the general domain of multimodal tasks.…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Jinlong He , Pengfei Li , Gang Liu , Shenjun Zhong

This paper explores the application of large language models (LLMs), like ChatGPT, for biometric tasks. We specifically examine the capabilities of ChatGPT in performing biometric-related tasks, with an emphasis on face recognition, gender…

Computer Vision and Pattern Recognition · Computer Science 2024-12-12 Ahmad Hassanpour , Yasamin Kowsari , Hatef Otroshi Shahreza , Bian Yang , Sebastien Marcel

Achieving deep alignment between vision and language remains a central challenge for Multimodal Large Language Models (MLLMs). These models often fail to fully leverage visual input, defaulting to strong language priors. Our approach first…

Computer Vision and Pattern Recognition · Computer Science 2025-07-03 Aarti Ghatkesar , Ganesh Venkatesh

Recently, Multimodal Large Language Models (MLLMs) have gained significant attention for their remarkable ability to process and analyze non-textual data, such as images, videos, and audio. Notably, several adaptations of general-domain…

Computer Vision and Pattern Recognition · Computer Science 2025-03-07 Wenhui Zhu , Xin Li , Xiwen Chen , Peijie Qiu , Vamsi Krishna Vasa , Xuanzhao Dong , Yanxi Chen , Natasha Lepore , Oana Dumitrascu , Yi Su , Yalin Wang

Large Language Models (LLMs) have demonstrated remarkable performance across various natural language tasks, marking significant strides towards general artificial intelligence. While general artificial intelligence is leveraged by…

Computation and Language · Computer Science 2023-10-31 Yizhe Yang , Huashan Sun , Jiawei Li , Runheng Liu , Yinghao Li , Yuhang Liu , Heyan Huang , Yang Gao

Multi-modal Large Language Model (MLLM) refers to a model expanded from a Large Language Model (LLM) that possesses the capability to handle and infer multi-modal data. Current MLLMs typically begin by using LLMs to decompose tasks into…

Computation and Language · Computer Science 2023-09-01 Yongqiang Zhao , Zhenyu Li , Feng Zhang , Xinhai Xu , Donghong Liu

Currently, image-text-driven multi-modal deep learning models have demonstrated their outstanding potential in many fields. In practice, tasks centered around facial images have broad application prospects. This paper presents…

Computer Vision and Pattern Recognition · Computer Science 2024-07-15 Dawei Dai , YuTang Li , YingGe Liu , Mingming Jia , Zhang YuanHui , Guoyin Wang

Recently, Multimodal Large Language Model (MLLM) represented by GPT-4V has been a new rising research hotspot, which uses powerful Large Language Models (LLMs) as a brain to perform multimodal tasks. The surprising emergent capabilities of…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Shukang Yin , Chaoyou Fu , Sirui Zhao , Ke Li , Xing Sun , Tong Xu , Enhong Chen

Multi-modal large language models (MLLMs) have demonstrated remarkable success in vision and visual-language tasks within the natural image domain. Owing to the significant diversities between the natural and remote sensing (RS) images, the…

Computer Vision and Pattern Recognition · Computer Science 2024-03-11 Wei Zhang , Miaoxin Cai , Tong Zhang , Yin Zhuang , Xuerui Mao

Multimodal large language models (MLLMs) carry the potential to support humans in processing vast amounts of information. While MLLMs are already being used as a fact-checking tool, their abilities and limitations in this regard are…

Computation and Language · Computer Science 2024-04-29 Jiahui Geng , Yova Kementchedjhieva , Preslav Nakov , Iryna Gurevych