English
Related papers

Related papers: ViTaL: A Multimodality Dataset and Benchmark for M…

200 papers

Advance in medical imaging is an important part in deep learning research. One of the goals of computer vision is development of a holistic, comprehensive model which can identify tumors from histology slides obtained via biopsies. A major…

Image and Video Processing · Electrical Eng. & Systems 2024-12-18 Vidit Gautam

Endometrial cancer, the fourth most common cancer in females in the United States, with the lifetime risk for developing this disease is approximately 2.8% in women. Precise histologic evaluation and molecular classification of endometrial…

Computer Vision and Pattern Recognition · Computer Science 2024-03-28 Manu Goyal , Laura J. Tafe , James X. Feng , Kristen E. Muller , Liesbeth Hondelink , Jessica L. Bentz , Saeed Hassanpour

Detecting early-stage ovarian cancer accurately and efficiently is crucial for timely treatment. Various methods for early diagnosis have been explored, including a focus on features derived from protein mass spectra, but these tend to…

Applications · Statistics 2024-01-30 Raymond J. Hinton , Jihyun Byun , Dixon Vimalajeewa , Brani Vidakovic

Accurate classification of brain tumors from magnetic resonance imaging (MRI) plays a critical role in early diagnosis and effective treatment planning. In this study, we propose a deep learning framework based on Vision Transformers (ViT)…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Faisal Ahmed

Cancer diseases constitute one of the most significant societal challenges. In this paper, we introduce a novel histopathological dataset for prostate cancer detection. The proposed dataset, consisting of over 2.6 million tissue patches…

Medical large vision-language Models (Med-LVLMs) have shown promise in clinical applications but suffer from factual inaccuracies and unreliable outputs, posing risks in real-world diagnostics. While RAG has emerged as a potential solution,…

Computation and Language · Computer Science 2026-05-05 Zhe Chen , Yusheng Liao , Zhiyuan Zhu , Haolin Li , Hongcheng Liu , Yanfeng Wang , Yu Wang

The integration of medical imaging and clinical text has enabled the emergence of generalist artificial intelligence (AI) systems for healthcare. However, pervasive biases, such as imbalanced disease prevalence, skewed anatomical region…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Cheng Li , Weijian Huang , Jiarun Liu , Hao Yang , Qi Yang , Song Wu , Ye Li , Hairong Zheng , Shanshan Wang

Background: The 2022 update of the Ovarian-Adnexal Reporting and Data System (O-RADS) ultrasound classification refines risk stratification for adnexal lesions, yet human interpretation remains subject to variability and conservative…

Breast cancer is one of the most common cancers affecting women worldwide. They include a group of malignant neoplasms with a variety of biological, clinical, and histopathological characteristics. There are more than 35 different…

Image and Video Processing · Electrical Eng. & Systems 2023-08-23 Abubakr Shafique , Ricardo Gonzalez , Liron Pantanowitz , Puay Hoon Tan , Alberto Machado , Ian A Cree , Hamid R. Tizhoosh

Despite significant advancements in general AI, its effectiveness in the medical domain is limited by the lack of specialized medical knowledge. To address this, we formulate GMAI-VL-5.5M, a multimodal medical dataset created by converting…

Computer Vision and Pattern Recognition · Computer Science 2025-03-28 Tianbin Li , Yanzhou Su , Wei Li , Bin Fu , Zhe Chen , Ziyan Huang , Guoan Wang , Chenglong Ma , Ying Chen , Ming Hu , Yanjun Li , Pengcheng Chen , Xiaowei Hu , Zhongying Deng , Yuanfeng Ji , Jin Ye , Yu Qiao , Junjun He

Breast cancer is a leading cause of death among women globally, and early detection is critical for improving survival rates. This paper introduces an innovative framework that integrates Vision Transformers (ViT) and Graph Neural Networks…

Computer Vision and Pattern Recognition · Computer Science 2025-07-21 Yeming Cai , Zhenglin Li , Yang Wang

Breast lesion detection in ultrasound is critical for breast cancer diagnosis. Existing methods mainly rely on individual 2D ultrasound images or combine unlabeled video and labeled 2D images to train models for breast lesion detection. In…

Image and Video Processing · Electrical Eng. & Systems 2022-07-04 Zhi Lin , Junhao Lin , Lei Zhu , Huazhu Fu , Jing Qin , Liansheng Wang

Whole abdominal organ segmentation is important in diagnosing abdomen lesions, radiotherapy, and follow-up. However, oncologists' delineating all abdominal organs from 3D volumes is time-consuming and very expensive. Deep learning-based…

Image and Video Processing · Electrical Eng. & Systems 2023-02-14 Xiangde Luo , Wenjun Liao , Jianghong Xiao , Jieneng Chen , Tao Song , Xiaofan Zhang , Kang Li , Dimitris N. Metaxas , Guotai Wang , Shaoting Zhang

Precise breast cancer classification on histopathological images has the potential to greatly improve the diagnosis and patient outcome in oncology. The data imbalance problem largely stems from the inherent imbalance within medical image…

Image and Video Processing · Electrical Eng. & Systems 2024-11-28 Majid Behzadpour , Bengie L. Ortiz , Ebrahim Azizi , Kai Wu

This paper introduces a new challenge and datasets to foster research toward designing systems that can understand medical videos and provide visual answers to natural language questions. We believe medical videos may provide the best…

Computer Vision and Pattern Recognition · Computer Science 2022-02-01 Deepak Gupta , Kush Attal , Dina Demner-Fushman

Deep learning provides an excellent avenue for optimizing diagnosis and patient monitoring for clinical-based applications, which can critically enhance the response time to the onset of various conditions. For cardiovascular disease, one…

Machine Learning · Computer Science 2023-02-23 Ankur Samanta , Mark Karlov , Meghna Ravikumar , Christian McIntosh Clarke , Jayakumar Rajadas , Kaveh Hassani

Accurate analysis of pathological images is essential for automated tumor diagnosis but remains challenging due to high structural similarity and subtle morphological variations in tissue images. Current vision-language (VL) models often…

Computer Vision and Pattern Recognition · Computer Science 2025-10-01 Yating Huang , Ziyan Huang , Lintao Xiang , Qijun Yang , Hujun Yin

Invasive ductal carcinoma is a prevalent, potentially deadly disease associated with a high rate of morbidity and mortality. Its malignancy is the second leading cause of death from cancer in women. The mammogram is an extremely useful…

Computer Vision and Pattern Recognition · Computer Science 2021-11-09 Rushabh Patel

Deep models based on vision transformer (ViT) and convolutional neural network (CNN) have demonstrated remarkable performance on natural datasets. However, these models may not be similar in medical imaging, where abnormal regions cover…

Computer Vision and Pattern Recognition · Computer Science 2026-02-11 Ahmad Chaddad , Yihang Wu , Xianrui Chen

Large-scale medical biobanks provide imaging data complemented by extensive tabular information, such as clinical measurements or demographics. However, this abundance of tabular attributes does not reflect real-world datasets, where only a…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Marta Hasny , Laura Daza , Keno Bressem , Maxime Di Folco , Julia Schnabel