English
Related papers

Related papers: MathFlow: Enhancing the Perceptual Flow of MLLMs f…

200 papers

While Large Language Models (LLMs) excel at reasoning on text and Vision-Language Models (VLMs) are highly effective for visual perception, applying those models for visual instruction-based planning remains a widely open problem. In this…

Machine Learning · Computer Science 2025-09-11 Mohamed Salim Aissi , Clemence Grislain , Mohamed Chetouani , Olivier Sigaud , Laure Soulier , Nicolas Thome

Foundational language models show a remarkable ability to learn new concepts during inference via context data. However, similar work for images lag behind. To address this challenge, we introduce FLoWN, a flow matching model that learns to…

Machine Learning · Computer Science 2025-04-22 Daniel Saragih , Deyu Cao , Tejas Balaji , Ashwin Santhosh

Multimodal Large Language Models (MLLMs) show impressive vision-language benchmark performance, yet growing concerns about data contamination (test set exposure during training) risk masking true generalization. This concern extends to…

Artificial Intelligence · Computer Science 2025-06-10 Ming Liu , Wensheng Zhang

Multimodal Large Language Models (MLLMs) have recently achieved remarkable progress in video understanding. However, their effectiveness in real-time streaming scenarios remains limited due to storage constraints of historical visual…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Xiangyu Zeng , Kefan Qiu , Qingyu Zhang , Xinhao Li , Jing Wang , Jiaxin Li , Ziang Yan , Kun Tian , Meng Tian , Xinhai Zhao , Yi Wang , Limin Wang

The event-based Vision-Language Model (VLM) recently has made good progress for practical vision tasks. However, most of these works just utilize CLIP for focusing on traditional perception tasks, which obstruct model understanding…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Pengteng Li , Yunfan Lu , Pinghao Song , Wuyang Li , Huizai Yao , Hui Xiong

Large Language Models (LLMs) are increasingly being adopted as tools for learning; however, most tools remain text-only, limiting their usefulness for domains where visualizations are essential, such as mathematics. Recent work shows that…

Artificial Intelligence · Computer Science 2025-11-12 Vishal Kumar , Shubhra Mishra , Rebecca Hao , Rizwaan Malik , David Broman , Dorottya Demszky

Large language models (LLMs) have been shown to be capable of impressive few-shot generalisation to new tasks. However, they still tend to perform poorly on multi-step logical reasoning problems. Here we carry out a comprehensive evaluation…

Artificial Intelligence · Computer Science 2022-05-20 Antonia Creswell , Murray Shanahan , Irina Higgins

Universal multimodal embedding (UME) maps heterogeneous inputs into a shared retrieval space with a single model. Recent approaches improve UME by generating explicit chain-of-thought (CoT) rationales before extracting embeddings, enabling…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Chenwei He , Xiangzhao Hao , Tianyu Yang , Yuxiang Ma , Yuheng Jia , Lingxiang Wu , Chaoyang Zhao , Haiyun Guo , Jinqiao Wang

Large Multimodal Models (LMMs) have recently demonstrated remarkable visual understanding performance on both vision-language and vision-centric tasks. However, they often fall short in integrating advanced, task-specific capabilities for…

Computer Vision and Pattern Recognition · Computer Science 2025-05-28 Yufei Zhan , Hongyin Zhao , Yousong Zhu , Shurong Zheng , Fan Yang , Ming Tang , Jinqiao Wang

Large Language Models (LLMs) suffer from critical reasoning gaps, including a tendency to hallucinate and poor accuracy in classifying logical fallacies. This limitation stems from their default System 1 processing, which is fast and…

Artificial Intelligence · Computer Science 2025-10-14 Olivia Peiyu Wang , Tashvi Bansal , Ryan Bai , Emily M. Chui , Leilani H. Gilpin

Large Language Models (LLMs) have demonstrated some significant capabilities across various domains; however, their effectiveness in spreadsheet related tasks remains underexplored. This study introduces a foundation for a comprehensive…

Software Engineering · Computer Science 2025-06-24 Simon Thorne

Multimodal Large Language Models (MLLMs) enhance the potential of natural language processing. However, their actual impact on document information extraction remains unclear. In particular, it is unclear whether an MLLM-only…

Computation and Language · Computer Science 2026-03-04 Jiyuan Shen , Peiyue Yuan , Atin Ghosh , Yifan Mai , Daniel Dahlmeier

Multimodal Large Language Models (MLLMs) are reshaping how modern agentic systems reason over sequential user-behavior data. However, whether textual or image representations of user behavior data are more effective for maximizing MLLM…

Artificial Intelligence · Computer Science 2025-11-07 Tianning Dong , Luyi Ma , Varun Vasudevan , Jason Cho , Sushant Kumar , Kannan Achan

Large reasoning models (LRMs) that generate long chains of thought now perform well on multi-step math, science, and coding tasks. However, their behavior is still unstable and hard to interpret, and existing analysis tools struggle with…

Artificial Intelligence · Computer Science 2026-04-09 Xiaoyu Xu , Yulan Pan , Xiaosong Yuan , Zhihong Shen , Minghao Su , Yuanhao Su , Xiaofeng Zhang

Multimodal large language models (MLLMs) have shown great potential in perception and interpretation tasks, but their capabilities in predictive reasoning remain under-explored. To address this gap, we introduce a novel benchmark that…

Computer Vision and Pattern Recognition · Computer Science 2023-10-23 Mingwei Zhu , Leigang Sha , Yu Shu , Kangjia Zhao , Tiancheng Zhao , Jianwei Yin

Large Language Models (LLMs) exhibit impressive performance across various domains but still struggle with arithmetic reasoning tasks. Recent work shows the effectiveness of prompt design methods in enhancing reasoning capabilities.…

Computation and Language · Computer Science 2024-10-11 Wenting Tan , Dongxiao Chen , Jieting Xue , Zihao Wang , Taijie Chen

A well-executed graphic design typically achieves harmony in two levels, from the fine-grained design elements (color, font and layout) to the overall design. This complexity makes the comprehension of graphic design challenging, for it…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 Jieru Lin , Danqing Huang , Tiejun Zhao , Dechen Zhan , Chin-Yew Lin

Chart understanding requires models to effectively analyze and reason about numerical data, textual elements, and complex visual components. Our observations reveal that the perception capabilities of existing large vision-language models…

Computer Vision and Pattern Recognition · Computer Science 2025-09-26 Junteng Liu , Weihao Zeng , Xiwen Zhang , Yijun Wang , Zifei Shan , Junxian He

Multimodal Large Language Models (MLLMs) hold promise for accelerating scientific discovery by interpreting complex experimental procedures. However, their true capabilities are poorly understood, as existing benchmarks neglect the…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Yicheng Xu , Yue Wu , Jiashuo Yu , Ziang Yan , Tianxiang Jiang , Yinan He , Qingsong Zhao , Kai Chen , Yu Qiao , Limin Wang , Manabu Okumura , Yi Wang

Monitoring continuous data for meaningful signals increasingly demands long-horizon, stateful reasoning over unstructured streams. However, today's LLM frameworks remain stateless and one-shot, and traditional Complex Event Processing (CEP)…

Databases · Computer Science 2026-04-07 Shu Chen , Junhan Liu , Deepti Raghavan , Ugur Cetintemel