English
Related papers

Related papers: Unlocking Cognitive Capabilities and Analyzing the…

200 papers

Multimodal Large Language Models (MLLMs) have shown strong performance in visual and audio understanding when evaluated in isolation. However, their ability to jointly reason over omni-modal (visual, audio, and textual) signals in long and…

Vision-language models (VLMs) are achieving increasingly strong performance on multimodal tasks. However, reasoning capabilities remain limited particularly for smaller VLMs, while those of large-language models (LLMs) have seen numerous…

Computation and Language · Computer Science 2024-03-20 Victor Carbune , Hassan Mansoor , Fangyu Liu , Rahul Aralikatte , Gilles Baechler , Jindong Chen , Abhanshu Sharma

Although Multimodal Large Language Models (MLLMs) demonstrate strong omni-modal perception, their ability to forecast future events from audio-visual cues remains largely unexplored, as existing benchmarks focus mainly on retrospective…

Computation and Language · Computer Science 2026-01-21 Qian Chen , Jinlan Fu , Changsong Li , See-Kiong Ng , Xipeng Qiu

Multimodal Large Language Models (MLLMs) have increasingly supported omni-modal processing across text, vision, and speech. However, existing evaluation frameworks for such models suffer from critical limitations, including modality…

Computation and Language · Computer Science 2026-04-29 Seunghee Kim , Ingyu Bang , Seokgyu Jang , Changhyeon Kim , Sanghwan Bae , Jihun Choi , Richeng Xuan , Taeuk Kim

While Multimodal Large Language Models (MLLMs) excel at single-image understanding, they exhibit significantly degraded performance in multi-image reasoning scenarios. Multi-image reasoning presents fundamental challenges including complex…

Computer Vision and Pattern Recognition · Computer Science 2026-01-13 Jianghao Yin , Qingbin Li , Kun Sun , Cheng Ding , Jie Wang , Qin Chen , Jie Zhou , Nan Wang , Changqing Li , Pei Wu , Jian Xu , Zheming Yang , Liang He

Large language models are increasingly integrated into decision-making in areas such as healthcare, law, finance, engineering, and government. Yet they share a critical limitation: they produce fluent outputs even when their internal…

Artificial Intelligence · Computer Science 2026-04-17 Rikard Rosenbacke , Carl Rosenbacke , Victor Rosenbacke , Martin McKee

Large Multimodal Models (LMMs) demonstrate significant cross-modal reasoning capabilities. However, financial applications face challenges due to the lack of high-quality multimodal reasoning datasets and the inefficiency of existing…

Computation and Language · Computer Science 2025-06-17 Kai Lan , Jiayong Zhu , Jiangtong Li , Dawei Cheng , Guang Chen , Changjun Jiang

With the current surge in spatial reasoning explorations, researchers have made significant progress in understanding indoor scenes, but still struggle with diverse applications such as robotics and autonomous driving. This paper aims to…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Peiwen Sun , Shiqiang Lang , Dongming Wu , Yi Ding , Kaituo Feng , Huadai Liu , Zhen Ye , Rui Liu , Yun-Hui Liu , Jianan Wang , Xiangyu Yue

Large vision-language models (LVLMs) have made substantial advances in reasoning tasks at the Olympiad level. Nevertheless, current Olympiad-level multimodal reasoning benchmarks for these models often emphasize single-image analysis and…

Computer Vision and Pattern Recognition · Computer Science 2026-04-23 Qiguang Chen , Chengyu Luan , Jiajun Wu , Qiming Yu , Yi Yang , Yizhuo Li , Jingqi Tong , Xiachong Feng , Libo Qin , Wanxiang Che

The paradigm of Multimodal Large Language Models (MLLMs) offers a promising blueprint for advancing the electromagnetic (EM) domain. However, prevailing approaches often deviate from the native MLLM paradigm, instead using task-specific or…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Junyu Shen , Zhendong She , Chenghanyu Zhang , Yuchuang Sun , Luqing Luo , Dingwei Tan , Zonghao Guo , Bo Guo , Zehua Han , Wupeng Xie , Yaxin Mu , Peng Zhang , Peipei Li , Fengxiang Wang , Yangang Sun , Maosong Sun

Multimodal large language models (MLLMs) perform strongly on natural images, yet their ability to understand discrete visual symbols remains unclear. We present a multi-domain benchmark spanning language, culture, mathematics, physics and…

To utilize visual information, Multimodal Large Language Model (MLLM) relies on the perception process of its vision encoder. The completeness and accuracy of visual perception significantly influence the precision of spatial reasoning,…

Computer Vision and Pattern Recognition · Computer Science 2025-02-25 Runpeng Yu , Xinyin Ma , Xinchao Wang

The application of reinforcement learning (RL) to enhance the reasoning capabilities of Multimodal Large Language Models (MLLMs) constitutes a rapidly advancing research area. While MLLMs extend Large Language Models (LLMs) to handle…

Artificial Intelligence · Computer Science 2025-05-22 Guanghao Zhou , Panjia Qiu , Cen Chen , Jie Wang , Zheming Yang , Jian Xu , Minghui Qiu

Large Language Models (LLMs) demonstrate strong reasoning performance, yet their ability to reliably monitor, diagnose, and correct their own errors remains limited. We introduce a psychologically grounded metacognitive framework that…

Computation and Language · Computer Science 2026-02-24 Abraham Paul Elenjical , Vivek Hruday Kavuri , Vasudeva Varma

While large multimodal models (LMMs) have demonstrated strong performance across various Visual Question Answering (VQA) tasks, certain challenges require complex multi-step reasoning to reach accurate answers. One particularly challenging…

Symbolic reasoning systems have been used in cognitive architectures to provide inference and planning capabilities. However, defining domains and problems has proven difficult and prone to errors. Moreover, Large Language Models (LLMs)…

Unlocking spatial reasoning in Multimodal Large Language Models (MLLMs) is crucial for enabling intelligent interaction with 3D environments. While prior efforts often rely on explicit 3D inputs or specialized model architectures, we ask:…

Computer Vision and Pattern Recognition · Computer Science 2025-11-06 Fangrui Zhu , Hanhui Wang , Yiming Xie , Jing Gu , Tianye Ding , Jianwei Yang , Huaizu Jiang

Large Vision--Language Models (LVLMs) hold great promise for advancing optical remote sensing (RS) analysis, yet existing reasoning segmentation frameworks couple linguistic reasoning and pixel prediction through end-to-end supervised…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Xu Zhang , Junyao Ge , Yang Zheng , Kaitai Guo , Jimin Liang

In order to enable fluid and natural human-machine speech interaction, existing full-duplex conversational systems often adopt modular architectures with auxiliary components such as voice activity detectors, interrupters, conversation…

Computation and Language · Computer Science 2025-05-26 Wenyi Yu , Siyin Wang , Xiaoyu Yang , Xianzhao Chen , Xiaohai Tian , Jun Zhang , Guangzhi Sun , Lu Lu , Yuxuan Wang , Chao Zhang

Reasoning is essential for effective communication and decision-making. While recent advances in LLMs and MLLMs have shown that incorporating explicit reasoning significantly improves understanding and generalization, reasoning in LSMs…

Computation and Language · Computer Science 2025-09-23 Zhifei Xie , Ziyang Ma , Zihang Liu , Kaiyu Pang , Hongyu Li , Jialin Zhang , Yue Liao , Deheng Ye , Chunyan Miao , Shuicheng Yan
‹ Prev 1 8 9 10 Next ›