English
Related papers

Related papers: A Fully Transformer Based Multimodal Framework for…

200 papers

Brain tumor segmentation based on multi-modal magnetic resonance imaging (MRI) plays a pivotal role in assisting brain cancer diagnosis, treatment, and postoperative evaluations. Despite the achieved inspiring performance by existing…

Image and Video Processing · Electrical Eng. & Systems 2022-11-16 Haoran Li , Cheng Li , Weijian Huang , Xiawu Zheng , Yan Xi , Shanshan Wang

Accurate segmentation of brain tumors in MRI scans is critical for clinical diagnosis and treatment planning. We propose a semi-supervised, two-stage framework that extends the ReCoSeg approach to the larger and more heterogeneous BraTS…

Image and Video Processing · Electrical Eng. & Systems 2025-08-05 Sara Yavari , Rahul Nitin Pandya , Jacob Furst

Phyllodes tumors (PTs) are rare fibroepithelial breast lesions that are difficult to classify preoperatively due to their radiological similarity to benign fibroadenomas. This often leads to unnecessary surgical excisions. To address this,…

Computer Vision and Pattern Recognition · Computer Science 2025-09-26 Farhan Fuad Abir , Abigail Elliott Daly , Kyle Anderman , Tolga Ozmen , Laura J. Brattain

Radiology narrative reports often describe characteristics of a patient's disease, including its location, size, and shape. Motivated by the recent success of multimodal learning, we hypothesized that this descriptive text could guide…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Zachary Huemann , Xin Tie , Junjie Hu , Tyler J. Bradshaw

Brain tumor segmentation remains challenging because the three standard sub-regions, i.e., whole tumor (WT), tumor core (TC), and enhancing tumor (ET), often exhibit ambiguous visual boundaries. Integrating radiological description texts…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Bahram Mohammadi , Ta Duc Huy , Afrouz Sheikholeslami , Qi Chen , Vu Minh Hieu Phan , Sam White , Minh-Son To , Xuyun Zhang , Amin Beheshti , Luping Zhou , Yuankai Qi

We introduce MATEX (Multi-scale Attention and Text-guided Explainability), a novel framework that advances interpretability in medical vision-language models by incorporating anatomically informed spatial reasoning. MATEX synergistically…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Muhammad Imran , Chi Lee , Yugyung Lee

The research on developing CNN-based fully-automated Brain-Tumor-Segmentation systems has been progressed rapidly. For the systems to be applicable in practice, a good The research on developing CNN-based fully-automated…

Image and Video Processing · Electrical Eng. & Systems 2022-05-04 Juncheng Tong , Chunyan Wang

Medical image segmentation remains challenging due to limited annotations for training, ambiguous anatomical features, and domain shifts. While vision-language models such as CLIP offer strong cross-modal representations, their potential…

Computer Vision and Pattern Recognition · Computer Science 2026-02-25 Taha Koleilat , Hojat Asgariandehkordi , Omid Nejati Manzari , Berardino Barile , Yiming Xiao , Hassan Rivaz

The high cure rate of cancer is inextricably linked to physicians' accuracy in diagnosis and treatment, therefore a model that can accomplish high-precision tumor segmentation has become a necessity in many applications of the medical…

Image and Video Processing · Electrical Eng. & Systems 2023-07-26 Zeqiu. Yu , Shuo. Han , Ziheng. Song

Accurate brain tumor segmentation from multi-modal magnetic resonance imaging (MRI) is a prerequisite for precise radiotherapy planning and surgical navigation. While recent Transformer-based models such as Swin UNETR have achieved…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Yan Zhou , Zhen Huang , Yingqiu Li , Yue Ouyang , Suncheng Xiang , Zehua Wang

We trained and applied an encoder-decoder model to semantically segment breast biopsy images into biologically meaningful tissue labels. Since conventional encoder-decoder networks cannot be applied directly on large biopsy images and the…

Computer Vision and Pattern Recognition · Computer Science 2017-10-12 Sachin Mehta , Ezgi Mercan , Jamen Bartlett , Donald Weaver , Joann Elmore , Linda Shapiro

CLIP and BiomedCLIP are examples of vision-language foundation models and offer strong cross-modal embeddings; however, they are not optimized for fine-grained medical retrieval tasks, such as retrieving clinically relevant radiology…

Computer Vision and Pattern Recognition · Computer Science 2026-01-12 Zhaohui Liang , Sivaramakrishnan Rajaraman , Niccolo Marini , Zhiyun Xue , Sameer Antani

We propose UTS, a unit-based tissue segmentation framework for histopathology that classifies each fixed-size 32 * 32 tile, rather than each pixel, as the segmentation unit. This approach reduces annotation effort and improves computational…

Image and Video Processing · Electrical Eng. & Systems 2025-11-05 Ashkan Shakarami , Azade Farshad , Yousef Yeganeh , Lorenzo Nicole , Peter Schüffler , Stefano Ghidoni , Nassir Navab

The recent vision transformer(i.e.for image classification) learns non-local attentive interaction of different patch tokens. However, prior arts miss learning the cross-scale dependencies of different pixels, the semantic correspondence of…

Computer Vision and Pattern Recognition · Computer Science 2021-06-29 Yuanfeng Ji , Ruimao Zhang , Huijie Wang , Zhen Li , Lingyun Wu , Shaoting Zhang , Ping Luo

Accurate skin-lesion segmentation remains a key technical challenge for computer-aided diagnosis of skin cancer. Convolutional neural networks, while effective, are constrained by limited receptive fields and thus struggle to model…

Computer Vision and Pattern Recognition · Computer Science 2025-09-04 Pengyang Yu , Haoquan Wang , Gerard Marks , Tahar Kechadi , Laurence T. Yang , Sahraoui Dhelim , Nyothiri Aung

Medical image segmentation is crucial for disease diagnosis and monitoring. Though effective, the current segmentation networks such as UNet struggle with capturing long-range features. More accurate models such as TransUNet, Swin-UNet, and…

Image and Video Processing · Electrical Eng. & Systems 2024-06-11 Khaled Alrfou , Tian Zhao

Existing deep learning models for chest radiology often neglect patient metadata, limiting diagnostic accuracy and fairness. To bridge this gap, we introduce MetaCheX, a novel multimodal framework that integrates chest X-ray images with…

Image and Video Processing · Electrical Eng. & Systems 2025-09-17 Nathan He , Cody Chen

Transformer, benefiting from global (long-range) information modeling using self-attention mechanism, has been successful in natural language processing and computer vision recently. Convolutional Neural Networks, capable of capturing local…

Image and Video Processing · Electrical Eng. & Systems 2022-05-18 Jiangyun Li , Wenxuan Wang , Chen Chen , Tianxiang Zhang , Sen Zha , Jing Wang , Hong Yu

Accurate segmentation of brain tumors from 3D multimodal MRI is vital for diagnosis and treatment planning across diverse brain tumors. This paper addresses the challenges posed by the BraTS 2023, presenting a unified transfer learning…

Image and Video Processing · Electrical Eng. & Systems 2024-12-12 Ramy A. Zeineldin , Franziska Mathis-Ullrich

Clinical cystoscopy, the current standard for bladder cancer diagnosis, suffers from significant reliance on physician expertise, leading to variability and subjectivity in diagnostic outcomes. There is an urgent need for objective,…

Image and Video Processing · Electrical Eng. & Systems 2025-08-22 Jinliang Yu , Mingduo Xie , Yue Wang , Tianfan Fu , Xianglai Xu , Jiajun Wang