English
Related papers

Related papers: A multimodal vision foundation model for generaliz…

200 papers

Depth estimation is a fundamental task in 3D computer vision, crucial for applications such as 3D reconstruction, free-viewpoint rendering, robotics, autonomous driving, and AR/VR technologies. Traditional methods relying on hardware…

Computer Vision and Pattern Recognition · Computer Science 2025-10-23 Zhen Xu , Hongyu Zhou , Sida Peng , Haotong Lin , Haoyu Guo , Jiahao Shao , Peishan Yang , Qinglin Yang , Sheng Miao , Xingyi He , Yifan Wang , Yue Wang , Ruizhen Hu , Yiyi Liao , Xiaowei Zhou , Hujun Bao

We present a keypoint-based foundation model for general purpose brain MRI registration, based on the recently-proposed KeyMorph framework. Our model, called BrainMorph, serves as a tool that supports multi-modal, pairwise, and scalable…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Alan Q. Wang , Rachit Saluja , Heejong Kim , Xinzi He , Adrian Dalca , Mert R. Sabuncu

Knee-Joint Osteoarthritis (KOA) is a prevalent cause of global disability and is inherently complex to diagnose due to its subtle radiographic markers and individualized progression. One promising classification avenue involves applying…

Image and Video Processing · Electrical Eng. & Systems 2023-11-13 Fabi Prezja , Leevi Annala , Sampsa Kiiskinen , Suvi Lahtinen , Timo Ojala

Many diagnostic and therapeutic clinical tasks for prostate cancer increasingly rely on multi-parametric MRI. Automating these tasks is challenging because they necessitate expert interpretations, which are difficult to scale to capitalise…

Existing multi-modal learning methods on fundus and OCT images mostly require both modalities to be available and strictly paired for training and testing, which appears less practical in clinical scenarios. To expand the scope of clinical…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Lehan Wang , Chongchong Qi , Chubin Ou , Lin An , Mei Jin , Xiangbin Kong , Xiaomeng Li

Recent advancements in foundation models, typically trained with self-supervised learning on large-scale and diverse datasets, have shown great potential in medical image analysis. However, due to the significant spatial heterogeneity of…

Computer Vision and Pattern Recognition · Computer Science 2024-01-25 Lingxiao Luo , Xuanzhong Chen , Bingda Tang , Xinsheng Chen , Rong Han , Chengpeng Hu , Yujiang Li , Ting Chen

Significant advancements in AI-driven multimodal medical image diagnosis have led to substantial improvements in ophthalmic disease identification in recent years. However, acquiring paired multimodal ophthalmic images remains prohibitively…

Computer Vision and Pattern Recognition · Computer Science 2025-09-11 Zhihao Zhao , Yinzheng Zhao , Junjie Yang , Xiangtong Yao , Quanmin Liang , Daniel Zapp , Kai Huang , Nassir Navab , M. Ali Nasseri

A fully automated knee MRI segmentation method to study osteoarthritis (OA) was developed using a novel hierarchical set of random forests (RF) classifiers to learn the appearance of cartilage regions and their boundaries. A neighborhood…

Computer Vision and Pattern Recognition · Computer Science 2019-03-12 Satyananda Kashyap , Honghai Zhang , Karan Rao , Milan Sonka

In ophthalmological imaging, multiple imaging systems, such as color fundus, infrared, fluorescein angiography, optical coherence tomography (OCT) or OCT angiography, are often involved to make a diagnosis of retinal disease. Multi-modal…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Aline Sindel , Bettina Hohberger , Andreas Maier , Vincent Christlein

Accurate compensation of brain deformation is a critical challenge for reliable image-guided neurosurgery, as surgical manipulation and tumor resection induce tissue motion that misaligns preoperative planning images with intraoperative…

Limited DXA access hinders osteoporosis screening. This proof-of-concept study proposes using widely available knee X-rays for opportunistic Bone Mineral Density (BMD) estimation via deep learning, emphasizing robust uncertainty…

Computer Vision and Pattern Recognition · Computer Science 2025-05-29 Long Hui , Wai Lok Yeung

Foundation models open up new possibilities for the use of AI in healthcare. However, even when pre-trained on health data, they still need to be fine-tuned for specific downstream tasks. Furthermore, although foundation models reduce the…

Computer Vision and Pattern Recognition · Computer Science 2025-10-15 Adam Tupper , Christian Gagné

Purpose: Hip fractures are a common cause of morbidity and mortality. Automatic identification and classification of hip fractures using deep learning may improve outcomes by reducing diagnostic errors and decreasing time to operation.…

While hyperspectral imaging provides rich spatial-spectral information across hundreds of narrow wavelength bands for precise material identification, ground-based hyperspectral pre-trained backbones remain absent, constrained by varying…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Guanyiman Fu , Jingtao Li , Zihang Cheng , Zhuanfeng Li , Diqi Chen , Yan Xu , Xiangyu Liu , Fengchao Xiong , Jianfeng Lu , Chengrong Chen , Jun Zhou

Automated clinical decision support for clear aligner orthodontics faces a key challenge: bridging geometric perception (3D tooth segmentation) with clinical reasoning (biomechanical feasibility). We address this with OrthOAI, introducing…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Edouard Lansiaux , Margaux Leman , Mehdi Ammi

Multimodal image registration is a challenging but essential step for numerous image-guided procedures. Most registration algorithms rely on the computation of complex, frequently non-differentiable similarity metrics to deal with the…

Computer Vision and Pattern Recognition · Computer Science 2023-07-20 Matteo Ronchetti , Wolfgang Wein , Nassir Navab , Oliver Zettinig , Raphael Prevost

Clinical diagnosis of meniscus injuries requires radiologists to integrate volumetric MRI evidence with patient context (e.g., sex, age, BMI) and to produce structured diagnostic reports. Existing knee MRI benchmarks are typically unimodal…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Shurui Xu , Siqi Yang , Weiping Ding , Hui Wang , Mengzhen Fan , Yuyu Sun , Shuyan Li

Deep learning underpins a wide range of applications in MRI, including reconstruction, artifact removal, and segmentation. However, progress has been driven largely by public datasets focused on brain and knee imaging, shaping how models…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Paula Arguello , Berk Tinaz , Mohammad Shahab Sepehri , Maryam Soltanolkotabi , Mahdi Soltanolkotabi

Medical foundation models, pre-trained with large-scale clinical data, demonstrate strong performance in diverse clinically relevant applications. RETFound, trained on nearly one million retinal images, exemplifies this approach in…

Gastrointestinal (GI) diseases represent a clinically significant burden, necessitating precise diagnostic approaches to optimize patient outcomes. Conventional histopathological diagnosis suffers from limited reproducibility and diagnostic…