English
Related papers

Related papers: Multimodal Large Language Models Meet Multimodal E…

200 papers

Large Language Models (LLMs) offer a promising approach to enhancing Explainable AI (XAI) by transforming complex machine learning outputs into easy-to-understand narratives, making model predictions more accessible to users, and helping…

Artificial Intelligence · Computer Science 2025-04-02 Ahsan Bilal , David Ebert , Beiyu Lin

Research increasingly leverages audio-visual materials to analyze emotions in political communication. Multimodal large language models (mLLMs) promise to enable such analyses through in-context learning. However, we lack systematic…

Computation and Language · Computer Science 2026-04-07 Hauke Licht

Language has long been conceived as an essential tool for human reasoning. The breakthrough of Large Language Models (LLMs) has sparked significant research interest in leveraging these models to tackle complex reasoning tasks. Researchers…

Large language models (LLMs) show promising capabilities in predicting human emotions from text. However, the mechanisms through which these models process emotional stimuli remain largely unexplored. Our study addresses this gap by…

Computation and Language · Computer Science 2025-07-01 Ala N. Tak , Amin Banayeeanzade , Anahita Bolourani , Mina Kian , Robin Jia , Jonathan Gratch

The emergence of Multimodal Large Language Models (MLLMs) has revolutionized image understanding by bridging textual and visual modalities. However, these models often struggle with capturing fine-grained semantic information, such as the…

Computer Vision and Pattern Recognition · Computer Science 2025-07-16 Jie Yang , Wang Zeng , Sheng Jin , Lumin Xu , Wentao Liu , Chen Qian , Zhen Li , Ruimao Zhang

This work investigates the capabilities of large language models (LLMs) in detecting and understanding human emotions through text. Drawing upon emotion models from psychology, we adopt an interdisciplinary perspective that integrates…

Computation and Language · Computer Science 2025-03-10 Florian Lecourt , Madalina Croitoru , Konstantin Todorov

Large language models (LLMs) and multimodal large language models (MLLMs) have significantly advanced artificial intelligence. However, visual reasoning, reasoning involving both visual and textual inputs, remains underexplored. Recent…

Computer Vision and Pattern Recognition · Computer Science 2025-04-18 I-Sheng Fang , Jun-Cheng Chen

Multimodal Large Models (MLMs) are becoming a significant research focus, combining powerful large language models with multimodal learning to perform complex tasks across different data modalities. This review explores the latest…

Machine Learning · Computer Science 2024-07-02 Xinji Mai , Zeng Tao , Junxiong Lin , Haoran Wang , Yang Chang , Yanlan Kang , Yan Wang , Wenqiang Zhang

The recent emergence of Multi-modal Large Language Models (MLLMs) has introduced a new dimension to the Text-rich Image Understanding (TIU) field, with models demonstrating impressive and inspiring performance. However, their rapid…

Computer Vision and Pattern Recognition · Computer Science 2025-02-25 Pei Fu , Tongkun Guan , Zining Wang , Zhentao Guo , Chen Duan , Hao Sun , Boming Chen , Jiayao Ma , Qianyi Jiang , Kai Zhou , Junfeng Luo

Traffic safety remains a critical global challenge, with traditional Advanced Driver-Assistance Systems (ADAS) often struggling in dynamic real-world scenarios due to fragmented sensor processing and susceptibility to adversarial…

Computer Vision and Pattern Recognition · Computer Science 2025-04-24 Mohammad Abu Tami , Mohammed Elhenawy , Huthaifa I. Ashqar

Achieving deep alignment between vision and language remains a central challenge for Multimodal Large Language Models (MLLMs). These models often fail to fully leverage visual input, defaulting to strong language priors. Our approach first…

Computer Vision and Pattern Recognition · Computer Science 2025-07-03 Aarti Ghatkesar , Ganesh Venkatesh

The rapid advancements in large Language models (LLMs) have significantly enhanced their reasoning capabilities, driven by various strategies such as multi-agent collaboration. However, unlike the well-established performance improvements…

Artificial Intelligence · Computer Science 2026-04-23 Zihan Chen , Song Wang , Zhen Tan , Xingbo Fu , Zhenyu Lei , Peng Wang , Huan Liu , Cong Shen , Jundong Li

The advent of Large Language Models (LLMs) has paved the way for AI search engines, e.g., SearchGPT, showcasing a new paradigm in human-internet interaction. However, most current AI search engines are limited to text-only settings,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-28 Dongzhi Jiang , Renrui Zhang , Ziyu Guo , Yanmin Wu , Jiayi Lei , Pengshuo Qiu , Pan Lu , Zehui Chen , Chaoyou Fu , Guanglu Song , Peng Gao , Yu Liu , Chunyuan Li , Hongsheng Li

The performance of ChatGPT\copyright{} and other LLMs has improved tremendously, and in online environments, they are increasingly likely to be used in a wide variety of situations, such as ChatBot on web pages, call center operations using…

Human-Computer Interaction · Computer Science 2025-02-19 Hiroki Tanioka , Tetsushi Ueta , Masahiko Sano

The exploration of multimodal language models integrates multiple data types, such as images, text, language, audio, and other heterogeneity. While the latest large language models excel in text-based tasks, they often struggle to…

Artificial Intelligence · Computer Science 2023-11-23 Jiayang Wu , Wensheng Gan , Zefeng Chen , Shicheng Wan , Philip S. Yu

Recently, the astonishing performance of large language models (LLMs) in natural language comprehension and generation tasks triggered lots of exploration of using them as central controllers to build agent systems. Multiple studies focus…

Computer Vision and Pattern Recognition · Computer Science 2025-04-14 Chenyu Wang , Weixin Luo , Sixun Dong , Xiaohua Xuan , Zhengxin Li , Lin Ma , Shenghua Gao

Multimodal recommender systems (MRS) integrate heterogeneous user and item data, such as text, images, and structured information, to enhance recommendation performance. The emergence of large language models (LLMs) introduces new…

Information Retrieval · Computer Science 2025-05-16 Alejo Lopez-Avila , Jinhua Du

Multimodal Large Language Models (MLLMs) have gained significant attention recently, showing remarkable potential in artificial general intelligence. However, assessing the utility of MLLMs presents considerable challenges, primarily due to…

Computation and Language · Computer Science 2024-06-12 Dongping Chen , Ruoxi Chen , Shilin Zhang , Yinuo Liu , Yaochen Wang , Huichi Zhou , Qihui Zhang , Yao Wan , Pan Zhou , Lichao Sun

With the recent emergence of revolutionary autonomous agentic systems, research community is witnessing a significant shift from traditional static, passive, and domain-specific AI agents toward more dynamic, proactive, and generalizable…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Huanjin Yao , Ruifei Zhang , Jiaxing Huang , Jingyi Zhang , Yibo Wang , Bo Fang , Ruolin Zhu , Yongcheng Jing , Shunyu Liu , Guanbin Li , Dacheng Tao

Multimodal large language models (MLLMs) have achieved remarkable success across a broad range of vision tasks. However, constrained by the capacity of their internal world knowledge, prior work has proposed augmenting MLLMs by…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Wenxuan Huang , Yu Zeng , Qiuchen Wang , Zhen Fang , Shaosheng Cao , Zheng Chu , Qingyu Yin , Shuang Chen , Zhenfei Yin , Lin Chen , Zehui Chen , Xu Tang , Yao Hu , Shaohui Lin , Philip Torr , Feng Zhao , Wanli Ouyang