English
Related papers

Related papers: Reasoning Visual Language Model for Chest X-Ray An…

200 papers

Many Vision-Language-Action (VLA) models are built upon an internal world model trained via next-frame prediction ``$v_t \rightarrow v_{t+1}$''. However, this paradigm attempts to predict the future frame's appearance directly, without…

Although large Vision-Language Models (VLMs) have demonstrated remarkable performance in a wide range of multimodal tasks, their true reasoning capabilities on human IQ tests remain underexplored. To advance research on the fluid…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Tan-Hanh Pham , Phu-Vinh Nguyen , Dang The Hung , Bui Trong Duong , Vu Nguyen Thanh , Chris Ngo , Tri Quang Truong , Truong-Son Hy

We introduce a radiology-focused visual language model designed to generate radiology reports from chest X-rays. Building on previous findings that large language models (LLMs) can acquire multimodal capabilities when aligned with…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Xi Zhang , Zaiqiao Meng , Jake Lever , Edmond S. L. Ho

Vision-Language-Action (VLA) models benefit from chain-of-thought (CoT) reasoning, but existing approaches incur high inference overhead and rely on discrete reasoning representations that mismatch continuous perception and control. We…

Chain-of-Thought (CoT) techniques have significantly enhanced reasoning in Vision-Language Models (VLMs). Extending this paradigm, Visual CoT integrates explicit visual edits, such as cropping or annotating regions of interest, into the…

Machine Learning · Computer Science 2025-09-30 Chunxue Xu , Yiwei Wang , Yujun Cai , Bryan Hooi , Songze Li

Large language models (LLMs) have shown impressive performance on complex reasoning by leveraging chain-of-thought (CoT) prompting to generate intermediate reasoning chains as the rationale to infer the answer. However, existing CoT studies…

Computation and Language · Computer Science 2024-05-21 Zhuosheng Zhang , Aston Zhang , Mu Li , Hai Zhao , George Karypis , Alex Smola

Recently, Chain-of-Thought (CoT) reasoning has significantly enhanced the capabilities of large language models (LLMs), but Vision-Language Models (VLMs) still struggle with multi-step reasoning tasks due to limited multimodal reasoning…

Computation and Language · Computer Science 2026-03-23 Yuliang Zhan , Xinyu Tang , Han Wan , Jian Li , Ji-Rong Wen , Hao Sun

As a cornerstone of patient care, clinical decision-making significantly influences patient outcomes and can be enhanced by large language models (LLMs). Although LLMs have demonstrated remarkable performance, their application to visual…

Computer Vision and Pattern Recognition · Computer Science 2025-06-16 Ji Young Byun , Young-Jin Park , Navid Azizan , Rama Chellappa

Reinforcement Learning Finetuning (RFT) has significantly advanced the reasoning capabilities of large language models (LLMs) by enabling long chains of thought, self-correction, and effective tool use. While recent works attempt to extend…

Machine Learning · Computer Science 2026-03-06 Mingyuan Wu , Jingcheng Yang , Jize Jiang , Meitang Li , Kaizhuo Yan , Hanchao Yu , Minjia Zhang , Chengxiang Zhai , Klara Nahrstedt

Vision-Language Models (VLMs) have made significant strides in static image understanding but continue to face critical hurdles in spatiotemporal reasoning. A major bottleneck is "multi-image reasoning hallucination", where a massive…

Artificial Intelligence · Computer Science 2026-04-14 Xiaoda Yang , Shuai Yang , Can Wang , Jingyang Xue , Menglan Tang , Checheng Yu , Xunzhe Zhou , Sashuai Zhou , Tao Jin , Lixin Yang , Xiangyu Yue , Zhou Zhao

Radiology report generation is critical for efficiency but current models lack the structured reasoning of experts, hindering clinical trust and explainability by failing to link visual findings to precise anatomical locations. This paper…

Artificial Intelligence · Computer Science 2026-03-03 Peiyuan Jing , Kinhei Lee , Zhenxuan Zhang , Huichi Zhou , Zhengqing Yuan , Zhifan Gao , Lei Zhu , Giorgos Papanastasiou , Yingying Fang , Guang Yang

Learning general-purpose reasoning capabilities has long been a challenging problem in AI. Recent research in large language models (LLMs), such as DeepSeek-R1, has shown that reinforcement learning techniques like GRPO can enable…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Jiaer Xia , Yuhang Zang , Peng Gao , Sharon Li , Kaiyang Zhou

The latest breakthroughs in large vision-language models, such as Bard and GPT-4, have showcased extraordinary abilities in performing a wide range of tasks. Such models are trained on massive datasets comprising billions of public…

Computer Vision and Pattern Recognition · Computer Science 2025-05-08 Omkar Thawakar , Abdelrahman Shaker , Sahal Shaji Mullappilly , Hisham Cholakkal , Rao Muhammad Anwer , Salman Khan , Jorma Laaksonen , Fahad Shahbaz Khan

Recent advances in vision language models (VLMs) have enabled broad progress in the general medical field. However, pathology still remains a more challenging subdomain, with current pathology specific VLMs exhibiting limitations in both…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Wenchuan Zhang , Penghao Zhang , Jingru Guo , Tao Cheng , Jie Chen , Shuwan Zhang , Zhang Zhang , Yuhao Yi , Hong Bu

Vision-language-action (VLA) models have emerged as the next generation of models in robotics. However, despite leveraging powerful pre-trained Vision-Language Models (VLMs), existing end-to-end VLA systems often lose key capabilities…

Robotics · Computer Science 2025-06-02 Zhongyi Zhou , Yichen Zhu , Junjie Wen , Chaomin Shen , Yi Xu

Chart understanding presents a critical test to the reasoning capabilities of Vision-Language Models (VLMs). Prior approaches face critical limitations: some rely on external tools, making them brittle and constrained by a predefined…

Computer Vision and Pattern Recognition · Computer Science 2025-09-12 Bohao Tang , Yan Ma , Fei Zhang , Jiadi Su , Ethan Chern , Zhulin Hu , Zhixin Wang , Pengfei Liu , Ya Zhang

Spatial reasoning from monocular images is essential for autonomous driving, yet current Vision-Language Models (VLMs) still struggle with fine-grained geometric perception, particularly under large scale variation and ambiguous object…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Yanchun Cheng , Rundong Wang , Xulei Yang , Alok Prakash , Daniela Rus , Marcelo H Ang , ShiJie Li

Radiology Report Generation (RRG) is a critical step toward automating healthcare workflows, facilitating accurate patient assessments, and reducing the workload of medical professionals. Despite recent progress in Large Medical…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Sarosij Bose , Ravi K. Rajendran , Biplob Debnath , Konstantinos Karydis , Amit K. Roy-Chowdhury , Srimat Chakradhar

This work explores enabling Chain-of-Thought (CoT) reasoning to link visual cues across multiple images. A straightforward solution is to adapt rule-based reinforcement learning for Vision-Language Models (VLMs). However, such methods…

Computer Vision and Pattern Recognition · Computer Science 2025-06-30 Xi Chen , Mingkang Zhu , Shaoteng Liu , Xiaoyang Wu , Xiaogang Xu , Yu Liu , Xiang Bai , Hengshuang Zhao

Machine reasoning has made great progress in recent years owing to large language models (LLMs). In the clinical domain, however, most NLP-driven projects mainly focus on clinical classification or reading comprehension, and under-explore…

Computation and Language · Computer Science 2024-05-13 Taeyoon Kwon , Kai Tzu-iunn Ong , Dongjin Kang , Seungjun Moon , Jeong Ryong Lee , Dosik Hwang , Yongsik Sim , Beomseok Sohn , Dongha Lee , Jinyoung Yeo