English
Related papers

Related papers: Colon-X: Advancing Intelligent Colonoscopy toward …

200 papers

Large language models (LLMs) have shown remarkable ability in various language tasks, especially with their emergent in-context learning capability. Extending LLMs to incorporate visual inputs, large vision-language models (LVLMs) have…

Machine Learning · Computer Science 2025-10-13 Aneesh Komanduri , Karuna Bhaila , Xintao Wu

Recent advances in reinforcement learning with verifiable, rule-based rewards have greatly enhanced the reasoning capabilities and out-of-distribution generalization of VLMs/LLMs, obviating the need for manually crafted reasoning chains.…

Artificial Intelligence · Computer Science 2025-05-27 Shaohao Rui , Kaitao Chen , Weijie Ma , Xiaosong Wang

Multimodal reasoning requires iterative coordination between language and vision, yet it remains unclear what constitutes a meaningful interleaved chain of thought. We posit that text and image thoughts should function as complementary…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Jiawei Gu , Yunzhuo Hao , Huichen Will Wang , Linjie Li , Michael Qizhe Shieh , Yejin Choi , Ranjay Krishna , Yu Cheng

Incentivizing the reasoning ability of Multimodal Large Language Models (MLLMs) is essential for medical applications to transparently analyze medical scans and provide reliable diagnosis. However, existing medical MLLMs rely solely on…

Computer Vision and Pattern Recognition · Computer Science 2025-10-22 Lehan Wang , Yi Qin , Honglong Yang , Xiaomeng Li

Large Language Models (LLMs) have achieved remarkable success in natural language tasks, yet understanding their reasoning processes remains a significant challenge. We address this by introducing XplainLLM, a dataset accompanying an…

Computation and Language · Computer Science 2024-09-24 Zichen Chen , Jianda Chen , Ambuj Singh , Misha Sra

The transition from task-specific artificial intelligence toward general-purpose foundation models raises fundamental questions about their capacity to support the integrated reasoning required in clinical medicine, where diagnosis demands…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Alexandru Florea , Shansong Wang , Mingzhe Hu , Qiang Li , Zach Eidex , Luke del Balzo , Mojtaba Safari , Xiaofeng Yang

Lung cancer clinical decision support demands precise reasoning across complex, multi-stage oncological workflows. Existing multimodal large language models (MLLMs) fail to handle guideline-constrained staging and treatment reasoning. We…

Recent advancements in multimodal large language models (MLLMs) have shown strong understanding of driving scenes, drawing interest in their application to autonomous driving. However, high-level reasoning in safety-critical scenarios,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-12 Seungjun Yu , Seonho Lee , Namho Kim , Jaeyo Shin , Junsung Park , Wonjeong Ryu , Raehyuk Jung , Hyunjung Shim

Large language models (LLMs) have shown impressive performance on complex reasoning by leveraging chain-of-thought (CoT) prompting to generate intermediate reasoning chains as the rationale to infer the answer. However, existing CoT studies…

Computation and Language · Computer Science 2024-05-21 Zhuosheng Zhang , Aston Zhang , Mu Li , Hai Zhao , George Karypis , Alex Smola

Understanding symptom-image associations is crucial for clinical reasoning. However, existing medical multimodal models often rely on simple one-to-one hard labeling, oversimplifying clinical reality where symptoms relate to multiple…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 You-Kyoung Na , Yeong-Jun Cho

In this paper, we present a holistic multimodal benchmark that evaluates the reasoning capabilities of MLLMs with an explicit focus on reasoning width, a complementary dimension to the more commonly studied reasoning depth. Specifically,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Mingrui Chen , Hexiong Yang , Haogeng Liu , Huaibo Huang , Ran He

Multimodal Large Language Models (MLLMs) show promise for medical applications, yet progress in dermatology lags due to limited training data, narrow task coverage, and lack of clinically-grounded supervision that mirrors expert diagnostic…

Computation and Language · Computer Science 2026-01-06 Jinghan Ru , Siyuan Yan , Yuguo Yin , Yuexian Zou , Zongyuan Ge

The ability to process information from multiple modalities and to reason through it step-by-step remains a critical challenge in advancing artificial intelligence. However, existing reasoning benchmarks focus on text-only reasoning, or…

Artificial Intelligence · Computer Science 2025-07-01 Yulun Jiang , Yekun Chai , Maria Brbić , Michael Moor

As opposed to evaluating computation and logic-based reasoning, current benchmarks for evaluating large language models (LLMs) in medicine are primarily focused on question-answering involving domain knowledge and descriptive reasoning.…

While many vision-language models (VLMs) are developed to answer well-defined, straightforward questions with highly specified targets, as in most benchmarks, they often struggle in practice with complex open-ended tasks, which usually…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Chenrui Fan , Yijun Liang , Shweta Bhardwaj , Kwesi Cobbina , Ming Li , Tianyi Zhou

With the increasing demand for step-wise, cross-modal, and knowledge-grounded reasoning, multimodal large language models (MLLMs) are evolving beyond the traditional fixed retrieve-then-generate paradigm toward more sophisticated agentic…

Artificial Intelligence · Computer Science 2026-03-03 Xuying Ning , Dongqi Fu , Tianxin Wei , Mengting Ai , Jiaru Zou , Ting-Wei Li , Hanghang Tong , Yada Zhu , Hendrik Hamann , Jingrui He

Large language models (LLMs) have exhibited remarkable capabilities across various domains and tasks, pushing the boundaries of our knowledge in learning and cognition. The latest model, OpenAI's o1, stands out as the first LLM with an…

Computation and Language · Computer Science 2024-09-24 Yunfei Xie , Juncheng Wu , Haoqin Tu , Siwei Yang , Bingchen Zhao , Yongshuo Zong , Qiao Jin , Cihang Xie , Yuyin Zhou

Surgical Video Question Answering (VideoQA) provides a promising paradigm for dynamic intraoperative interpretation, enabling real-time decision support and context-aware retrieval in clinical environments. Nevertheless, existing approaches…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Diandian Guo , Xikai Yang , Ruiyang Li , Jialun Pei , Pheng-Ann Heng

We present a multi-task framework for the MediaEval Medico 2025 challenge, leveraging a LoRA-tuned Florence-2 model for simultaneous visual question answering (VQA), explanation generation, and visual grounding. The proposed system…

Computer Vision and Pattern Recognition · Computer Science 2025-11-07 Itbaan Safwan , Muhammad Annas Shaikh , Muhammad Haaris , Ramail Khan , Muhammad Atif Tahir

Medical reasoning in large language models (LLMs) aims to emulate clinicians' diagnostic thinking, but current benchmarks such as MedQA-USMLE, MedMCQA, and PubMedQA often mix reasoning with factual recall. We address this by separating 11…

‹ Prev 1 8 9 10 Next ›