English
Related papers

Related papers: MIRAGE: Multimodal foundation model and benchmark …

200 papers

Foundation models (FMs) are driving a prominent shift in biomedical imaging from task-specific models to unified backbone models for diverse tasks. This opens an avenue to integrate imaging, pathology, clinical records, and genomics data…

Quantitative Methods · Quantitative Biology 2026-04-23 Amgad Muneer , Kai Zhang , Ibraheem Hamdi , Rizwan Qureshi , Muhammad Waqas , Shereen Fouad , Hazrat Ali , Syed Muhammad Anwar , Jia Wu

Significant advancements in AI-driven multimodal medical image diagnosis have led to substantial improvements in ophthalmic disease identification in recent years. However, acquiring paired multimodal ophthalmic images remains prohibitively…

Computer Vision and Pattern Recognition · Computer Science 2025-09-11 Zhihao Zhao , Yinzheng Zhao , Junjie Yang , Xiangtong Yao , Quanmin Liang , Daniel Zapp , Kai Huang , Nassir Navab , M. Ali Nasseri

Frequent subgraph mining (FSM) is an important task for exploratory data analysis on graph data. Over the years, many algorithms have been proposed to solve this task. These algorithms assume that the data structure of the mining task is…

Databases · Computer Science 2013-07-24 Mansurul A Bhuiyan , Mohammad Al Hasan

Optical coherence tomography (OCT) imaging is a well-known technology for visualizing retinal layers and helps ophthalmologists to detect possible diseases. Accurate and early diagnosis of common retinal diseases can prevent the patients…

Image and Video Processing · Electrical Eng. & Systems 2022-03-04 Mohammad Rahimzadeh , Mahmoud Reza Mohammadi

Accurate diagnosis of glaucoma is challenging, as early-stage changes are subtle and often lack clear structural or appearance cues. Most existing approaches rely on a single modality, such as fundus or optical coherence tomography (OCT),…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Zhiwei Wang , Yuxing Li , Meilu Zhu , Defeng He , Edmund Y. Lam

In ophthalmological imaging, multiple imaging systems, such as color fundus, infrared, fluorescein angiography, optical coherence tomography (OCT) or OCT angiography, are often involved to make a diagnosis of retinal disease. Multi-modal…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Aline Sindel , Bettina Hohberger , Andreas Maier , Vincent Christlein

At the present time Optical Coherence Tomography (OCT) is among the most commonly used non-invasive imaging methods for the acquisition of large volumetric scans of human retinal tissues and vasculature. To resolve decisive information from…

Computer Vision and Pattern Recognition · Computer Science 2021-11-02 D. Sitenko , B. Boll , C. Schnörr

Mean Deviation (MD) is a critical metric for assessing visual field loss in ophthalmology. While previous work has focused solely on predicting MD from Optical Coherence Tomography (OCT), it is intuitive to assume that combining OCT with…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Haojie Yin , Chengcheng Feng , Tianyi Liu , Tianqi Zhang , Kaizhu Huang

Artificial Intelligence (AI) has demonstrated significant potential in healthcare, particularly in disease diagnosis and treatment planning. Recent progress in Medical Large Vision-Language Models (Med-LVLMs) has opened up new possibilities…

Machine Learning · Computer Science 2025-03-04 Peng Xia , Kangyu Zhu , Haoran Li , Tianze Wang , Weijia Shi , Sheng Wang , Linjun Zhang , James Zou , Huaxiu Yao

Despite the revolutionary impact of AI and the development of locally trained algorithms, achieving widespread generalized learning from multi-modal data in medical AI remains a significant challenge. This gap hinders the practical…

Computer Vision and Pattern Recognition · Computer Science 2024-01-24 Fatema-E Jannat , Sina Gholami , Minhaj Nur Alam , Hamed Tabkhi

Automated analysis of optical coherence tomography (OCT) and OCT angiography (OCTA) images is critical for robust ophthalmic diagnosis. Existing mainstream methods trained from scratch rely heavily on massive data and model scale, thereby…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Xiaofei Su , Zengshuo Wang , Minghe Sun , Xin Zhao , Mingzhu Sun

Brain foundation models have achieved remarkable advances across a wide range of neuroscience tasks. However, most existing models are limited to a single functional modality, restricting their ability to exploit complementary…

Machine Learning · Computer Science 2026-05-18 Hanning Guo , Hanwen Bi , Farah Abdellatif , Andrei Galbenus , Jon. N. Shah , Abigail Morrison , Jürgen Dammers

Stroke is a major public health problem, affecting millions worldwide. Deep learning has recently demonstrated promise for enhancing the diagnosis and risk prediction of stroke. However, existing methods rely on costly medical imaging…

Image and Video Processing · Electrical Eng. & Systems 2025-12-17 Saeed Shurrab , Aadim Nepal , Terrence J. Lee-St. John , Nicola G. Ghazi , Bartlomiej Piechowski-Jozwiak , Farah E. Shamout

Ultra-wide optical coherence tomography angiography (UW-OCTA) is an emerging imaging technique that offers significant advantages over traditional OCTA by providing an exceptionally wide scanning range of up to 24 x 20 $mm^{2}$, covering…

Image and Video Processing · Electrical Eng. & Systems 2023-11-20 Hao Wei , Peilun Shi , Guitao Bai , Minqing Zhang , Shuangle Li , Wu Yuan

The rapid evolution of Retrieval-Augmented Generation (RAG) toward multimodal, high-stakes enterprise applications has outpaced the development of domain specific evaluation benchmarks. Existing datasets often rely on general-domain corpora…

Artificial Intelligence · Computer Science 2026-01-23 Chandan Kumar Sahu , Premith Kumar Chilukuri , Matthew Hetrich

The increasing prevalence of retinal diseases poses a significant challenge to the healthcare system, as the demand for ophthalmologists surpasses the available workforce. This imbalance creates a bottleneck in diagnosis and treatment,…

Image and Video Processing · Electrical Eng. & Systems 2024-08-15 Jia-Hong Huang

The advent of foundation models (FMs) in healthcare offers unprecedented opportunities to enhance medical diagnostics through automated classification and segmentation tasks. However, these models also raise significant concerns about their…

Computer Vision and Pattern Recognition · Computer Science 2024-12-09 Ruinan Jin , Zikang Xu , Yuan Zhong , Qiongsong Yao , Qi Dou , S. Kevin Zhou , Xiaoxiao Li

Many eye diseases like Diabetic Macular Edema (DME), Age-related Macular Degeneration (AMD), and Glaucoma manifest in the retina, can cause irreversible blindness or severely impair the central version. The Optical Coherence Tomography…

Image and Video Processing · Electrical Eng. & Systems 2023-03-10 Nchongmaje Ndipenoch , Alina Miron , Zidong Wang , Yongmin Li

Advances in optical coherence tomography (OCT) have enabled noninvasive imaging of substructures of the human retina with high spatial resolution. OCT examinations are now a standard procedure in clinics and an integral part of ophthalmic…

Human-Computer Interaction · Computer Science 2022-12-22 Martin Röhlig , Oliver Stachs , Heidrun Schumann

Optical Coherence Tomography Angiography (OCTA) and its derived en-face projections provide high-resolution visualization of the retinal and choroidal vasculature, which is critical for the rapid and accurate diagnosis of retinal diseases.…

Computer Vision and Pattern Recognition · Computer Science 2025-09-10 Pooya Khosravi , Kun Han , Anthony T. Wu , Arghavan Rezvani , Zexin Feng , Xiaohui Xie