English
Related papers

Related papers: Patho-R1: A Multimodal Reinforcement Learning-Base…

200 papers

Large Language Models (LLMs) demonstrate enhanced capabilities and reliability by reasoning more, evolving from Chain-of-Thought prompting to product-level solutions like OpenAI o1. Despite various efforts to improve LLM reasoning,…

Computer Vision and Pattern Recognition · Computer Science 2025-05-05 Yuhao Dong , Zuyan Liu , Hai-Long Sun , Jingkang Yang , Winston Hu , Yongming Rao , Ziwei Liu

Vision-Language Models (VLMs) often suffer from visual hallucinations: generating things that are not consistent with visual inputs and language shortcuts, where they skip the visual part and just rely on text priors. These issues arise…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Zongxia Li , Wenhao Yu , Chengsong Huang , Zhenwen Liang , Rui Liu , Fuxiao Liu , Jingxi Che , Dian Yu , Jordan Boyd-Graber , Haitao Mi , Dong Yu

The application of rule-based reinforcement learning (RL) to multimodal large language models (MLLMs) introduces unique challenges and potential deviations from findings in text-only domains, particularly for perception-heavy tasks. This…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Zifu Wang , Junyi Zhu , Bo Tang , Zhiyu Li , Feiyu Xiong , Jiaqian Yu , Matthew B. Blaschko

Fundus imaging such as CFP, OCT and UWF is crucial for the early detection of retinal anomalies and diseases. Fundus image understanding, due to its knowledge-intensive nature, poses a challenging vision-language task. An emerging approach…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Yuchuan Deng , Qijie Wei , Kaiheng Qian , Jiazhen Liu , Zijie Xin , Bangxiang Lan , Jingyu Liu , Jianfeng Dong , Xirong Li

Reinforcement learning from verifiable rewards (RLVR) has demonstrated remarkable effectiveness in improving the reasoning capabilities of large language models. As models evolve into natively multimodal architectures, extending RLVR to…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Chuanyu Qin , Chenxu Yang , Qingyi Si , Naibin Gu , Dingyu Yao , Zheng Lin , Peng Fu , Nan Duan , Jiaqi Wang

While Reinforcement Learning with Verifiable Reward (RLVR) significantly advances image reasoning in Large Vision-Language Models (LVLMs), its application to complex video reasoning remains underdeveloped. This gap stems primarily from a…

Computer Vision and Pattern Recognition · Computer Science 2025-10-02 Congzhi Zhang , Zhibin Wang , Yinchao Ma , Jiawei Peng , Yihan Wang , Qiang Zhou , Jun Song , Bo Zheng

Vision-Language Foundation Models (VLFM) have shown a tremendous increase in performance in terms of generating high-resolution, photorealistic natural images. While VLFMs show a rich understanding of semantic content across modalities,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Parham Saremi , Amar Kumar , Mohamed Mohamed , Zahra TehraniNasab , Tal Arbel

While recent advances in reinforcement learning have significantly enhanced reasoning capabilities in large language models (LLMs), these techniques remain underexplored in multi-modal LLMs for video captioning. This paper presents the…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Desen Meng , Rui Huang , Zhilin Dai , Xinhao Li , Yifan Xu , Jun Zhang , Zhenpeng Huang , Meng Zhang , Lingshu Zhang , Yi Liu , Limin Wang

Current multi-instance learning algorithms for pathology image analysis often require a substantial number of Whole Slide Images for effective training but exhibit suboptimal performance in scenarios with limited learning data. In clinical…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Linhao Qu , Dingkang Yang , Dan Huang , Qinhao Guo , Rongkui Luo , Shaoting Zhang , Xiaosong Wang

Recent advancements in reasoning-enhanced large language models (LLMs), such as DeepSeek-R1 and OpenAI-o3, have demonstrated significant progress. However, their application in professional medical contexts remains underexplored,…

Computation and Language · Computer Science 2025-03-11 Pengcheng Qiu , Chaoyi Wu , Shuyu Liu , Weike Zhao , Zhuoxia Chen , Hongfei Gu , Chuanjin Peng , Ya Zhang , Yanfeng Wang , Weidi Xie

Parallel thinking has emerged as a novel approach for enhancing the reasoning capabilities of large language models (LLMs) by exploring multiple reasoning paths concurrently. However, activating such capabilities through training remains…

Computation and Language · Computer Science 2025-09-15 Tong Zheng , Hongming Zhang , Wenhao Yu , Xiaoyang Wang , Runpeng Dai , Rui Liu , Huiwen Bao , Chengsong Huang , Heng Huang , Dong Yu

Acute poly-substance intoxication requires rapid, life-saving decisions under substantial uncertainty, as clinicians must rely on incomplete ingestion details and nonspecific symptoms. Effective diagnostic reasoning in this chaotic…

Computation and Language · Computer Science 2026-04-01 Nico Oberländer , David Bani-Harouni , Tobias Zellner , Nassir Navab , Florian Eyer , Matthias Keicher

Recent large reasoning models (LRMs) have demonstrated strong reasoning capabilities through reinforcement learning (RL). These improvements have primarily been observed within the short-context reasoning tasks. In contrast, extending LRMs…

Computation and Language · Computer Science 2025-05-28 Fanqi Wan , Weizhou Shen , Shengyi Liao , Yingcheng Shi , Chenliang Li , Ziyi Yang , Ji Zhang , Fei Huang , Jingren Zhou , Ming Yan

Medical image segmentation is crucial for clinical diagnosis, yet existing models are limited by their reliance on explicit human instructions and lack the active reasoning capabilities to understand complex clinical questions. While recent…

Computer Vision and Pattern Recognition · Computer Science 2025-06-13 Yu Huang , Zelin Peng , Yichen Zhao , Piao Yang , Xiaokang Yang , Wei Shen

We present S1-VL, a multimodal reasoning model for scientific domains that natively supports two complementary reasoning paradigms: Scientific Reasoning, which relies on structured chain-of-thought, and Thinking-with-Images, which enables…

Computer Vision and Pattern Recognition · Computer Science 2026-04-24 Qingxiao Li , Lifeng Xu , QingLi Wang , Yudong Bai , Mingwei Ou , Shu Hu , Nan Xu

Tabular data serves as the backbone of modern data analysis and scientific research. While Large Language Models (LLMs) fine-tuned via Supervised Fine-Tuning (SFT) have significantly improved natural language interaction with such…

Although Large Language Models (LLMs) have demonstrated remarkable progress, their proficiency in graph-related tasks remains notably limited, hindering the development of truly general-purpose models. Previous attempts, including…

Machine Learning · Computer Science 2025-08-20 Xiaojun Guo , Ang Li , Yifei Wang , Stefanie Jegelka , Yisen Wang

Large vision-language models (LVLMs) have witnessed significant progress on visual understanding tasks. However, they often prioritize language knowledge over image information on visual reasoning tasks, incurring performance degradation.…

Computer Vision and Pattern Recognition · Computer Science 2025-10-16 Jingqi Zhou , Sheng Wang , Jingwei Dong , Kai Liu , Lei Li , Jiahui Gao , Jiyue Jiang , Lingpeng Kong , Chuan Wu

Video reasoning segmentation (VRS) endeavors to delineate referred objects in videos guided by implicit instructions that encapsulate human intent and temporal logic. Previous approaches leverage large vision language models (LVLMs) to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-05 Sitong Gong , Lu Zhang , Yunzhi Zhuge , Xu Jia , Pingping Zhang , Huchuan Lu

Pest-induced crop losses pose a major threat to global food security and sustainable agricultural development. While recent advances in Multimodal Large Language Models (MLLMs) have shown strong potential for visual understanding and smart…

Computer Vision and Pattern Recognition · Computer Science 2026-05-08 Xueheng Li , Yu Wang , Tao Hu , Ji Huang , Ke Cao , Qize Yang , Rui Li , Jie Zhang , Chengjun Xie