English
Related papers

Related papers: MediRound: Multi-Round Entity-Level Reasoning Segm…

200 papers

Visual grounding is essential for precise perception and reasoning in multimodal large language models (MLLMs), especially in medical imaging domains. While existing medical visual grounding benchmarks primarily focus on single-image…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Jingkun Yue , Siqi Zhang , Zinan Jia , Huihuan Xu , Zongbo Han , Xiaohong Liu , Guangyu Wang

Multi-modal brain tumor segmentation is critical for clinical diagnosis, and it requires accurate identification of distinct internal anatomical subregions. While the recent prompt-based segmentation paradigms enable interactive experiences…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Yuxiang Luo , Qing Xu , Hai Huang , Yuqi Ouyang , Zhen Chen , Wenting Duan

Effective clinical decision-making depends on iterative, multimodal reasoning across diverse sources of evidence. The recent emergence of multimodal reasoning models has significantly transformed the landscape of solving complex tasks.…

Computation and Language · Computer Science 2025-11-04 Zhongzhen Huang , Linjie Mu , Yakun Zhu , Xiangyu Zhao , Shaoting Zhang , Xiaofan Zhang

As hubs of human activity, urban surfaces consist of a wealth of semantic entities. Segmenting these various entities from satellite imagery is crucial for a range of downstream applications. Current advanced segmentation models can…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Yu Wang , Yi Wang , Rui Dai , Yujie Wang , Kaikui Liu , Xiangxiang Chu , Yansheng Li

Segmentation of magnetic resonance images (MRI) facilitates analysis of human brain development by delineating anatomical structures. However, in infants and young children, accurate segmentation is challenging due to development and…

Machine Learning · Computer Science 2026-04-01 Malte Hoffmann , Lilla Zöllei , Adrian V. Dalca

Large language models (LLMs) have demonstrated strong performance and rapid progress in a wide range of medical reasoning tasks. However, their sequential autoregressive decoding forces inherently parallel clinical reasoning, such as…

Machine Learning · Computer Science 2026-04-17 Jianwen Chen , Xinyu Yang , Peng Xia , Arian Azarang , Yueh Z Lee , Gang Li , Hongtu Zhu , Yun Li , Beidi Chen , Huaxiu Yao

Fine-grained entity recognition is crucial for reasoning and decision-making in task-oriented dialogues, yet current large language models (LLMs) continue to face challenges in domain adaptation and retrieval controllability. We introduce…

Computation and Language · Computer Science 2025-11-18 Liang Xue , Haoyu Liu , Yajun Tian , Xinyu Zhong , Yang Liu

Recently, automated medical image segmentation methods based on deep learning have achieved great success. However, they heavily rely on large annotated datasets, which are costly and time-consuming to acquire. Few-shot learning aims to…

Artificial Intelligence · Computer Science 2024-08-20 Jiayu Huo , Ruiqiang Xiao , Haotian Zheng , Yang Liu , Sebastien Ourselin , Rachel Sparks

Recent advances in vision-language models (VLMs) have achieved remarkable performance on standard medical benchmarks, yet their true clinical reasoning ability remains unclear. Existing datasets predominantly emphasize classification…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Miao Jing , Mengting Jia , Junling Lin , Zhongxia Shen , Huan Gao , Mingkun Xu , Shangyang Li

Existing medical RAG systems mainly leverage knowledge from medical knowledge bases, neglecting the crucial role of experiential knowledge derived from similar patient cases -- a key component of human clinical reasoning. To bridge this…

Computation and Language · Computer Science 2025-05-27 Yuxing Lu , Gecheng Fu , Wei Wu , Xukai Zhao , Sin Yee Goi , Jinzhuo Wang

Remote sensing has become critical for understanding environmental dynamics, urban planning, and disaster management. However, traditional remote sensing workflows often rely on explicit segmentation or detection methods, which struggle to…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Kaiyu Li , Zepeng Xin , Li Pang , Chao Pang , Yupeng Deng , Jing Yao , Guisong Xia , Deyu Meng , Zhi Wang , Xiangyong Cao

Medical image segmentation remains challenging due to limited annotations for training, ambiguous anatomical features, and domain shifts. While vision-language models such as CLIP offer strong cross-modal representations, their potential…

Computer Vision and Pattern Recognition · Computer Science 2026-02-25 Taha Koleilat , Hojat Asgariandehkordi , Omid Nejati Manzari , Berardino Barile , Yiming Xiao , Hassan Rivaz

The automatic generation of brain CT reports has gained widespread attention, given its potential to assist radiologists in diagnosing cranial diseases. However, brain CT scans involve extensive medical entities, such as diverse anatomy…

Artificial Intelligence · Computer Science 2025-03-25 Xiaodan Zhang , Yanzhao Shi , Junzhong Ji , Chengxin Zheng , Liangqiong Qu

Existing reasoning segmentation approaches typically fine-tune multimodal large language models (MLLMs) using image-text pairs and corresponding mask labels. However, they exhibit limited generalization to out-of-distribution scenarios…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Song Wang , Gongfan Fang , Lingdong Kong , Xiangtai Li , Jianyun Xu , Sheng Yang , Qiang Li , Jianke Zhu , Xinchao Wang

MLLMs MLLMs are beginning to appear in clinical workflows, but their ability to perform complex medical reasoning remains unclear. We present Med-CMR, a fine-grained Medical Complex Multimodal Reasoning benchmark. Med-CMR distinguishes from…

Most current medical vision language models struggle to jointly generate diagnostic text and pixel-level segmentation masks in response to complex visual questions. This represents a major limitation towards clinical application, as…

Computer Vision and Pattern Recognition · Computer Science 2025-10-22 Chengrun Li , Corentin Royer , Haozhe Luo , Bastian Wittmann , Xia Li , Ibrahim Hamamci , Sezgin Er , Anjany Sekuboyina , Bjoern Menze

With the widespread application of electroencephalography (EEG) in neuroscience and clinical practice, efficiently retrieving and semantically interpreting large-scale, multi-source, heterogeneous EEG data has become a pressing challenge.…

Computation and Language · Computer Science 2025-10-14 Yi Wang , Haoran Luo , Lu Meng , Ziyu Jia , Xinliang Zhou , Qingsong Wen

In the diverse field of medical imaging, automatic segmentation has numerous applications and must handle a wide variety of input domains, such as different types of Computed Tomography (CT) scans and Magnetic Resonance (MR) images. This…

Image and Video Processing · Electrical Eng. & Systems 2024-11-26 Chengyin Li , Hui Zhu , Rafi Ibn Sultan , Hassan Bagher Ebadian , Prashant Khanduri , Chetty Indrin , Kundan Thind , Dongxiao Zhu

Segmentation based on language has been a popular topic in computer vision. While recent advances in multimodal large language models (MLLMs) have endowed segmentation systems with reasoning capabilities, these efforts remain confined by…

Computer Vision and Pattern Recognition · Computer Science 2026-02-05 Tianming Liang , Qirui Du , Jian-Fang Hu , Haichao Jiang , Zicheng Lin , Wei-Shi Zheng

Medical image segmentation is evolving from task-specific models toward generalizable frameworks. Recent research leverages Multi-modal Large Language Models (MLLMs) as autonomous agents, employing reinforcement learning with verifiable…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Shengyuan Liu , Liuxin Bao , Qi Yang , Wanting Geng , Boyun Zheng , Chenxin Li , Wenting Chen , Houwen Peng , Yixuan Yuan