English
Related papers

Related papers: Multimodal Fine-grained Reasoning for Post Quality…

200 papers

Multimodal sentiment analysis remains a challenging task due to the inherent heterogeneity across modalities. Such heterogeneity often manifests as asynchronous signals, imbalanced information between modalities, and interference from…

Multimedia · Computer Science 2025-11-26 Yadong Liu , Shangfei Wang

We introduce FinMMDocR, a novel bilingual multimodal benchmark for evaluating multimodal large language models (MLLMs) on real-world financial numerical reasoning. Compared to existing benchmarks, our work delivers three major advancements.…

Reasoning is central to human intelligence, enabling structured problem-solving across diverse tasks. Recent advances in large language models (LLMs) have greatly enhanced their reasoning abilities in arithmetic, commonsense, and symbolic…

In this paper, we introduce BMMR, a large-scale bilingual, multimodal, multi-disciplinary reasoning dataset for the community to develop and evaluate large multimodal models (LMMs). BMMR comprises 110k college-level questions spanning 300…

Understanding high-resolution (HR) images remains a critical challenge for multimodal large language models (MLLMs). Recent approaches leverage vision-based retrieval-augmented generation (RAG) to retrieve query-relevant crops from HR…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Fan Yang , Xingping Dong , Xin Yu , Wenhan Luo , Wei Liu , Kaihao Zhang

Multimodal reasoning is a challenging task that requires models to reason across multiple modalities to answer questions. Existing approaches have made progress by incorporating language and visual modalities into a two-stage reasoning…

Artificial Intelligence · Computer Science 2024-07-04 Cheng Tan , Jingxuan Wei , Zhangyang Gao , Linzhuang Sun , Siyuan Li , Ruifeng Guo , Bihui Yu , Stan Z. Li

While Large Multimodal Models (LMMs) excel in general visual tasks, their deployment in specialized financial contexts remains insufficient. Existing benchmarks prioritize isolated charts, often overlooking the need to integrate data from…

Computational Engineering, Finance, and Science · Computer Science 2026-05-19 Jiayong Zhu , Jiangtong Li , Jinru Ding , Dawei Cheng , Jie Xu , Feng Yu

Recent strides in multimodal large language models (MLLMs) have significantly advanced their performance in many reasoning tasks. However, Abstract Visual Reasoning (AVR) remains a critical challenge, primarily due to limitations in…

Computer Vision and Pattern Recognition · Computer Science 2025-10-22 Hao Yan , Xingchen Liu , Hao Wang , Zhenbiao Cao , Handong Zheng , Liang Yin , Xinxing Su , Zihao Chen , Jihao Wu , Minghui Liao , Chao Weng , Wei Chen , Yuliang Liu , Xiang Bai

Image-text retrieval, as a fundamental and important branch of information retrieval, has attracted extensive research attentions. The main challenge of this task is cross-modal semantic understanding and matching. Some recent works focus…

Computer Vision and Pattern Recognition · Computer Science 2023-04-24 Weijing Chen , Linli Yao , Qin Jin

Due to the manifold ranking method has a significant effect on the ranking of unknown data based on known data by using a weighted network, many researchers use the manifold ranking method to solve the document summarization task. However,…

Computation and Language · Computer Science 2019-07-09 Jianying Lin , Rui Liu , Quanye Jia

Multimodal emotion analysis is shifting from static classification to generative reasoning. Beyond simple label prediction, robust affective reasoning must synthesize fine-grained signals such as facial micro-expressions and prosodic which…

Multimedia · Computer Science 2026-02-05 Zhixian Zhao , Wenjie Tian , Lei Xie

The prevailing paradigm for training large reasoning models--combining Supervised Fine-Tuning (SFT) with Reinforcement Learning with Verifiable Rewards (RLVR)--is fundamentally constrained by its reliance on high-quality, human-annotated…

Machine Learning · Computer Science 2026-03-24 Yuanfu Wang , Zhixuan Liu , Xiangtian Li , Chaochao Lu , Chao Yang

Due to the exponential growth of information and the need for efficient information consumption the task of summarization has gained paramount importance. Evaluating summarization accurately and objectively presents significant challenges,…

Computation and Language · Computer Science 2024-12-31 Dong Yuan , Eti Rastogi , Fen Zhao , Sagar Goyal , Gautam Naik , Sree Prasanna Rajagopal

Multimodal fake news video detection is a crucial research direction for maintaining the credibility of online information. Existing studies primarily verify content authenticity by constructing multimodal feature fusion representations or…

Computer Vision and Pattern Recognition · Computer Science 2026-04-09 Hui Li , Peien Ding , Jun Li , Guoqi Ma , Zhanyu Liu , Ge Xu , Junfeng Yao , Jinsong Su

Multimodal large language models (MLLMs) have shown promising reasoning abilities, yet evaluating their performance in specialized domains remains challenging. STEM reasoning is a particularly valuable testbed because it provides highly…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Jing Jin , Hao Liu , Yan Bai , Yihang Lou , Zhenke Wang , Tianrun Yuan , Juntong Chen , Yongkang Zhu , Fanhu Zeng , Xuanyu Zhu , Tao Feng , Yige Xu

Fine-grained visual categorization is to recognize hundreds of subcategories belonging to the same basic-level category, which is a highly challenging task due to the quite subtle and local visual distinctions among similar subcategories.…

Computer Vision and Pattern Recognition · Computer Science 2019-02-21 Xiangteng He , Yuxin Peng

Large vision-and-language models (VLMs) trained to match images with text on large-scale datasets of image-text pairs have shown impressive generalization ability on several vision and language tasks. Several recent works, however, showed…

Computer Vision and Pattern Recognition · Computer Science 2024-03-07 Navid Rajabi , Jana Kosecka

Should we trust Large Language Models (LLMs) with high accuracy? LLMs achieve high accuracy on reasoning benchmarks, but correctness alone does not reveal the quality of the reasoning used to produce it. This highlights a fundamental…

Computation and Language · Computer Science 2026-04-15 Manas Pathak , Xingyao Chen , Shuozhe Li , Amy Zhang , Liu Leqi

Conditional inference on joint textual and visual clues is a multi-modal reasoning task that textual clues provide prior permutation or external knowledge, which are complementary with visual content and pivotal to deducing the correct…

Computation and Language · Computer Science 2023-05-09 Yunxin Li , Baotian Hu , Xinyu Chen , Yuxin Ding , Lin Ma , Min Zhang

The fusion of Large Language Models with vision models is pioneering new possibilities in user-interactive vision-language tasks. A notable application is reasoning segmentation, where models generate pixel-level segmentation masks by…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Donggon Jang , Yucheol Cho , Suin Lee , Taehyeon Kim , Dae-Shik Kim