English
Related papers

Related papers: Multi-modal Reasoning with LLMs for Visual Semanti…

200 papers

Visual Language Models (VLMs) are now increasingly being merged with Large Language Models (LLMs) to enable new capabilities, particularly in terms of improved interactivity and open-ended responsiveness. While these are remarkable…

DeepSeek-R1-Zero has successfully demonstrated the emergence of reasoning capabilities in LLMs purely through Reinforcement Learning (RL). Inspired by this breakthrough, we explore how RL can be utilized to enhance the reasoning capability…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Wenxuan Huang , Bohan Jia , Zijie Zhai , Shaosheng Cao , Zheyu Ye , Fei Zhao , Zhe Xu , Xu Tang , Yao Hu , Shaohui Lin

The growing complexity of log data in modern software systems has prompted the use of Large Language Models (LLMs) for automated log analysis. Current approaches typically rely on direct supervised fine-tuning (SFT) on log-label pairs.…

Tables are a fundamental medium for organizing and analyzing data, making table reasoning a critical capability for intelligent systems. Although large language models (LLMs) exhibit strong general reasoning abilities, they still struggle…

Artificial Intelligence · Computer Science 2026-03-24 Lang Cao , Jingxian Xu , Hanbing Liu , Jinyu Wang , Mengyu Zhou , Haoyu Dong , Shi Han , Dongmei Zhang

Reinforcement learning (RL) finetuning has become a key technique for enhancing large language models (LLMs) on reasoning-intensive tasks, motivating its extension to vision-language models (VLMs). While RL-tuned VLMs improve on visual…

Machine Learning · Computer Science 2026-05-22 Rosie Zhao , Anshul Shah , Xiaoyu Zhu , Xinke Deng , Zhongyu Jiang , Yang Yang , Joerg Liebelt , Arnab Mondal

"Thinking with images" has emerged as an effective paradigm for advancing visual reasoning, extending beyond text-only chains of thought by injecting visual evidence into intermediate reasoning steps. However, existing methods fall short of…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Qixun Wang , Yang Shi , Yifei Wang , Yuanxing Zhang , Pengfei Wan , Kun Gai , Xianghua Ying , Yisen Wang

While state-of-the-art vision-language models (VLMs) have demonstrated remarkable capabilities in complex visual-text tasks, their success heavily relies on massive model scaling, limiting their practical deployment. Small-scale VLMs offer…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Huilin Deng , Ding Zou , Rui Ma , Hongchen Luo , Yang Cao , Yu Kang

Reinforcement learning (RL) has shown impressive results in sequential decision-making tasks. Meanwhile, Large Language Models (LLMs) and Vision-Language Models (VLMs) have emerged, exhibiting impressive capabilities in multimodal…

Extending Reinforcement Learning with Verifiable Rewards (RLVR) to multimodal large language models (MLLMs) faces a fundamental challenge: their responses inherently interleave perception-related tokens, which ground visual content, with…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Jinda Lu , Junkang Wu , Jinghan Li , Kexin Huang , Shuo Yang , Guoyin Wang , Jiancan Wu , Xiang Wang , Xiangnan He

Mathematical reasoning is a challenging task for large language models (LLMs), while the scaling relationship of it with respect to LLM capacity is under-explored. In this paper, we investigate how the pre-training loss, supervised data…

Computation and Language · Computer Science 2023-09-14 Zheng Yuan , Hongyi Yuan , Chengpeng Li , Guanting Dong , Keming Lu , Chuanqi Tan , Chang Zhou , Jingren Zhou

Visual reasoning, particularly spatial reasoning, is a challenging cognitive task that requires understanding object relationships and their interactions within complex environments, especially in robotics domain. Existing vision_language…

Robotics · Computer Science 2025-11-03 Simindokht Jahangard , Mehrzad Mohammadi , Abhinav Dhall , Hamid Rezatofighi

Vision Language Models (VLMs) are impressive at visual question answering and image captioning. But they underperform on multi-step visual reasoning -- even compared to LLMs on the same tasks presented in text form -- giving rise to…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Simon Park , Abhishek Panigrahi , Yun Cheng , Dingli Yu , Anirudh Goyal , Sanjeev Arora

The diagnosis of pathological images is often limited by expert availability and regional disparities, highlighting the importance of automated diagnosis using Vision-Language Models (VLMs). Traditional multimodal models typically emphasize…

Computer Vision and Pattern Recognition · Computer Science 2025-04-21 Jianyu Wu , Hao Yang , Xinhua Zeng , Guibing He , Zhiyu Chen , Zihui Li , Xiaochuan Zhang , Yangyang Ma , Run Fang , Yang Liu

In the era of Large Language Models (LLMs), alignment has emerged as a fundamental yet challenging problem in the pursuit of more reliable, controllable, and capable machine intelligence. The recent success of reasoning models and…

Machine Learning · Computer Science 2025-07-18 Hao Sun , Mihaela van der Schaar

Prompting techniques have significantly enhanced the capabilities of Large Language Models (LLMs) across various complex tasks, including reasoning, planning, and solving math word problems. However, most research has predominantly focused…

Computation and Language · Computer Science 2024-05-24 Neisarg Dave , Daniel Kifer , C. Lee Giles , Ankur Mali

Reinforcement Learning has significantly advanced the reasoning capabilities of Multimodal Large Language Models (MLLMs), yet the resulting policies remain brittle against real-world visual degradations such as blur, compression artifacts,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Rui Liu , Dian Yu , Haolin Liu , Yucheng Shi , Tong Zheng , Runpeng Dai , Haitao Mi , Pratap Tokekar , Leoweiliang

Visual reasoning is challenging, requiring both precise object grounding and understanding complex spatial relationships. Existing methods fall into two camps: language-only chain-of-thought approaches, which demand large-scale (image,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-10 Damiano Marsili , Georgia Gkioxari

Reasoning is a critical frontier for advancing medical image analysis, where transparency and trustworthiness play a central role in both clinician trust and regulatory approval. Although Medical Visual Language Models (VLMs) show promise…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Jiazhen Pan , Che Liu , Junde Wu , Fenglin Liu , Jiayuan Zhu , Hongwei Bran Li , Chen Chen , Cheng Ouyang , Daniel Rueckert

Visual reasoning is crucial for understanding complex multimodal data and advancing Artificial General Intelligence. Existing methods enhance the reasoning capability of Multimodal Large Language Models (MLLMs) through Reinforcement…

Computer Vision and Pattern Recognition · Computer Science 2026-05-07 Chaoyang Wang , Zeyu Zhang , Meng Meng , Xu Zhou , Haiyun Jiang

Recent large vision-language models (LVLMs) have demonstrated impressive reasoning ability by generating long chain-of-thought (CoT) responses. However, CoT reasoning in multimodal contexts is highly vulnerable to visual hallucination…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Yongchang Zhang , Oliver Ma , Tianyi Liu , Guangquan Zhou , Yang Chen
‹ Prev 1 4 5 6 7 8 10 Next ›