English
Related papers

Related papers: Colon-X: Advancing Intelligent Colonoscopy toward …

200 papers

Clinical decision-making in radiology increasingly benefits from artificial intelligence (AI), particularly through large language models (LLMs). However, traditional retrieval-augmented generation (RAG) systems for radiology question…

Multimodal Large Language Models (MLLMs) have achieved impressive progress in natural image reasoning, yet their potential in medical imaging remains underexplored, especially in clinical anatomical surgical images. Anatomy understanding…

Computer Vision and Pattern Recognition · Computer Science 2025-12-25 Ziyang Song , Zelin Zang , Zuyao Chen , Xusheng Liang , Dong Yi , Jinlin Wu , Hongbin Liu , Jiebo Luo , Zhen. Lei

There is vivid research on adapting Large Language Models (LLMs) to perform a variety of tasks in high-stakes domains such as healthcare. Despite their popularity, there is a lack of understanding of the extent and contributing factors that…

Computation and Language · Computer Science 2024-06-07 Anand Subramanian , Viktor Schlegel , Abhinav Ramesh Kashyap , Thanh-Tung Nguyen , Vijay Prakash Dwivedi , Stefan Winkler

Detection and diagnosis of colon polyps are key to preventing colorectal cancer. Recent evidence suggests that AI-based computer-aided detection (CADe) and computer-aided diagnosis (CADx) systems can enhance endoscopists' performance and…

Image and Video Processing · Electrical Eng. & Systems 2024-03-05 Carlo Biffi , Giulio Antonelli , Sebastian Bernhofer , Cesare Hassan , Daizen Hirata , Mineo Iwatate , Andreas Maieron , Pietro Salvagnini , Andrea Cherubini

Pathological diagnosis remains the definitive standard for identifying tumors. The rise of multimodal large models has simplified the process of integrating image analysis with textual descriptions. Despite this advancement, the substantial…

Computer Vision and Pattern Recognition · Computer Science 2024-08-14 Xiaomin Wu , Rui Xu , Pengchen Wei , Wenkang Qin , Peixiang Huang , Ziheng Li , Lin Luo

Diagnosing and managing oral diseases necessitate advanced visual interpretation across diverse imaging modalities and integrated information synthesis. While current AI models excel at isolated tasks, they often fall short in addressing…

Reasoning is a fundamental capability for solving complex multi-step problems, particularly in visual contexts where sequential step-wise understanding is essential. Existing approaches lack a comprehensive framework for evaluating visual…

Clinical check-up reports are multimodal documents that combine page layouts, tables, numerical biomarkers, abnormality flags, imaging findings, and domain-specific terminology. Such heterogeneous evidence is difficult for laypersons to…

Computation and Language · Computer Science 2026-05-14 Sike Xiang , Shuang Chen , Kevin Qinghong Lin , Jialin Yu , Yijia Sun , Philip Torr , Amir Atapour-Abarghouei

Reliable interpretation of multimodal data in dentistry is essential for automated oral healthcare, yet current multimodal large language models (MLLMs) struggle to capture fine-grained dental visual details and lack sufficient reasoning…

Recent advancements in large reasoning models have fueled growing interest in extending such capabilities to multimodal domains. However, despite notable progress in visual reasoning, the lack of transparent and reproducible data curation…

Artificial Intelligence · Computer Science 2025-12-08 Kaichen Zhang , Keming Wu , Zuhao Yang , Bo Li , Kairui Hu , Bin Wang , Ziwei Liu , Xingxuan Li , Lidong Bing

The rapid advancements in large language models (LLMs) have unlocked their potential for multimodal tasks, where text and visual data are processed jointly. However, applying LLMs to medical imaging, particularly for chest X-rays (CXR),…

Image and Video Processing · Electrical Eng. & Systems 2025-02-11 Nicholas Evans , Stephen Baker , Miles Reed

Background: Despite the current ubiquity of Large Language Models (LLMs) across the medical domain, there is a surprising lack of studies which address their reasoning behaviour. We emphasise the importance of understanding reasoning…

Computation and Language · Computer Science 2025-07-29 Shamus Sim , Tyrone Chen

Multimodal large language models (MLLMs) promise enhanced reasoning by integrating diverse inputs such as text, vision, and audio. Yet cross-modal reasoning remains underexplored, with conflicting reports on whether added modalities help or…

Computation and Language · Computer Science 2026-05-01 Yucheng Wang , Yifan Hou , Aydin Javadov , Mubashara Akhtar , Mrinmaya Sachan

Multi-modal Large Language Models (MLLMs) are increasingly prominent in the field of artificial intelligence. These models not only excel in traditional vision-language tasks but also demonstrate impressive performance in contemporary…

Computer Vision and Pattern Recognition · Computer Science 2023-12-06 Xiaotian Han , Quanzeng You , Yongfei Liu , Wentao Chen , Huangjie Zheng , Khalil Mrini , Xudong Lin , Yiqi Wang , Bohan Zhai , Jianbo Yuan , Heng Wang , Hongxia Yang

As reasoning models scale rapidly, the essential role of multimodality in human cognition has come into sharp relief, driving a growing need to probe vision-centric cognitive behaviors. Yet, existing multimodal benchmarks either…

Reasoning Large Language Models (LLMs) with enhanced accuracy and explainability are increasingly being adopted in the medical domain, as the life-critical nature of clinical decision-making demands reliable support. Despite these…

Computation and Language · Computer Science 2025-11-12 Sung-Min Lee , Siyoon Lee , Juyeon Kim , Kyoungmin Roh

Chest X-ray (CXR) reporting follows a region-based clinical workflow in which radiologists inspect anatomical regions and integrate localized findings into a final report. However, existing resources for CXR report generation provide these…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Yichen Zhao , Zelin Peng , Fenghe Tang , Piao Yang , Yu Huang , Wei Shen

Multimodal Mathematical Reasoning (MMR) has recently attracted increasing attention for its capability to solve mathematical problems involving both textual and visual modalities. However, current models still face significant challenges in…

Artificial Intelligence · Computer Science 2026-04-15 Tianyu Yang , Sihong Wu , Yilun Zhao , Zhenwen Liang , Lisen Dai , Chen Zhao , Minhao Cheng , Arman Cohan , Xiangliang Zhang

With the current surge in spatial reasoning explorations, researchers have made significant progress in understanding indoor scenes, but still struggle with diverse applications such as robotics and autonomous driving. This paper aims to…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Peiwen Sun , Shiqiang Lang , Dongming Wu , Yi Ding , Kaituo Feng , Huadai Liu , Zhen Ye , Rui Liu , Yun-Hui Liu , Jianan Wang , Xiangyu Yue

The reasoning gap between large and compact vision-language models (VLMs) limits the deployment of medical AI on portable clinical devices. Compact VLMs of 2--4B parameters can run on resource-constrained hardware but lack the multi-step…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Runze Ma , Shunbo Jia , Haonan Lyu , Guo Liu , Caizhi Liao