English
Related papers

Related papers: Decipher-MR: A Vision-Language Foundation Model fo…

200 papers

Recent advances in brain-vision decoding have driven significant progress, reconstructing with high fidelity perceived visual stimuli from neural activity, e.g., functional magnetic resonance imaging (fMRI), in the human visual cortex. Most…

Computer Vision and Pattern Recognition · Computer Science 2025-07-04 Le Xu , Qi Zhang , Qixian Zhang , Hongyun Zhang , Duoqian Miao , Cairong Zhao

Foundation models have emerged as a powerful paradigm in computational pathology (CPath), enabling scalable and generalizable analysis of histopathological images. While early developments centered on uni-modal models trained solely on…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Dong Li , Guihong Wan , Xintao Wu , Xinyu Wu , Xiaohui Chen , Yi He , Christine G. Lian , Peter K. Sorger , Yevgeniy R. Semenov , Chen Zhao

Deformable medical image registration is an essential task in computer-assisted interventions. This problem is particularly relevant to oncological treatments, where precise image alignment is necessary for tracking tumor growth, assessing…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Stefano Fogarollo , Gregor Laimer , Reto Bale , Matthias Harders

Medical vision foundational models are used for a wide variety of tasks, including medical image segmentation and registration. This work evaluates the ability of these models to predict disease progression using a simple linear probe. We…

Image and Video Processing · Electrical Eng. & Systems 2025-03-24 Basar Demir , Soumitri Chattopadhyay , Thomas Hastings Greer , Boqi Chen , Marc Niethammer

Detail features of magnetic resonance images play a cru-cial role in accurate medical diagnosis and treatment, as they capture subtle changes that pose challenges for doc-tors when performing precise judgments. However, the widely utilized…

Computer Vision and Pattern Recognition · Computer Science 2024-05-10 Mengxiao Geng , Jiahao Zhu , Xiaolin Zhu , Qiqing Liu , Dong Liang , Qiegen Liu

Building a joint face-skull morphable model holds great potential for applications such as remote diagnostics, surgical planning, medical education, and physically based facial simulation. However, realizing this vision is constrained by…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Zidu Wang , Meng Xu , Miao Xu , Hengyuan Ma , Jiankuo Zhao , Xutao Li , Xiangyu Zhu , Zhen Lei

This paper presents a novel approach towards creating a foundational model for aligning neural data and visual stimuli across multimodal representationsof brain activity by leveraging contrastive learning. We used electroencephalography…

Computer Vision and Pattern Recognition · Computer Science 2024-11-18 Matteo Ferrante , Tommaso Boccato , Grigorii Rashkov , Nicola Toschi

Magnetic resonance imaging (MRI) is a widely used radiological modality renowned for its radiation-free, comprehensive insights into the human body, facilitating medical diagnoses. However, the drawback of prolonged scan times hinders its…

Research studies have shown no qualms about using data driven deep learning models for downstream tasks in medical image analysis, e.g., anatomy segmentation and lesion detection, disease diagnosis and prognosis, and treatment planning.…

Image and Video Processing · Electrical Eng. & Systems 2022-04-06 Jiahao Huang , Yingying Fang , Yang Nan , Huanjun Wu , Yinzhe Wu , Zhifan Gao , Yang Li , Zidong Wang , Pietro Lio , Daniel Rueckert , Yonina C. Eldar , Guang Yang

Artificial intelligence (AI) is vital in ophthalmology, tackling tasks like diagnosis, classification, and visual question answering (VQA). However, existing AI models in this domain often require extensive annotation and are task-specific,…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Danli Shi , Weiyi Zhang , Xiaolan Chen , Yexin Liu , Jiancheng Yang , Siyu Huang , Yih Chung Tham , Yingfeng Zheng , Mingguang He

Magnetic resonance imaging (MRI) is a cornerstone of clinical neuroimaging, yet conventional MRIs provide qualitative information heavily dependent on scanner hardware and acquisition settings. While quantitative MRI (qMRI) offers intrinsic…

One of the most common tasks in medical imaging is semantic segmentation. Achieving this segmentation automatically has been an active area of research, but the task has been proven very challenging due to the large variation of anatomy…

Computer Vision and Pattern Recognition · Computer Science 2018-04-10 Holger R. Roth , Chen Shen , Hirohisa Oda , Masahiro Oda , Yuichiro Hayashi , Kazunari Misawa , Kensaku Mori

Reasoning is a critical frontier for advancing medical image analysis, where transparency and trustworthiness play a central role in both clinician trust and regulatory approval. Although Medical Visual Language Models (VLMs) show promise…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Jiazhen Pan , Che Liu , Junde Wu , Fenglin Liu , Jiayuan Zhu , Hongwei Bran Li , Chen Chen , Cheng Ouyang , Daniel Rueckert

Human decision-making often relies on visual information from multiple perspectives or views. In contrast, machine learning-based object recognition utilizes information from a single image of the object. However, the information conveyed…

Computer Vision and Pattern Recognition · Computer Science 2025-10-01 Mona Alzahrani , Muhammad Usman , Salma Kammoun , Saeed Anwar , Tarek Helmy

Foundation models have transformed vision and language by learning general-purpose representations from large-scale unlabeled data, yet 3D medical imaging lacks analogous approaches. Existing self-supervised methods rely on low-level…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Yunhe Gao , Yabin Zhang , Chong Wang , Jiaming Liu , Maya Varma , Jean-Benoit Delbrouck , Akshay Chaudhari , Curtis Langlotz

Deep learning has emerged as a transformative approach for solving complex pattern recognition and object detection challenges. This paper focuses on the application of a novel detection framework based on the RT-DETR model for analyzing…

Computer Vision and Pattern Recognition · Computer Science 2025-01-29 Weijie He , Yuwei Zhang , Ting Xu , Tai An , Yingbin Liang , Bo Zhang

Foundation models are widely employed in medical image analysis, due to their high adaptability and generalizability for downstream tasks. With the increasing number of foundation models being released, model selection has become an…

Image and Video Processing · Electrical Eng. & Systems 2025-01-27 Fuping Wu , Bartlomiej W. Papiez

Performing magnetic resonance imaging (MRI) reconstruction from under-sampled k-space data can accelerate the procedure to acquire MRI scans and reduce patients' discomfort. The reconstruction problem is usually formulated as a denoising…

Image and Video Processing · Electrical Eng. & Systems 2023-12-11 Tianqi Xiang , Wenjun Yue , Yiqun Lin , Jiewen Yang , Zhenkun Wang , Xiaomeng Li

Medical image segmentation is crucial for clinical diagnosis, yet existing models are limited by their reliance on explicit human instructions and lack the active reasoning capabilities to understand complex clinical questions. While recent…

Computer Vision and Pattern Recognition · Computer Science 2025-06-13 Yu Huang , Zelin Peng , Yichen Zhao , Piao Yang , Xiaokang Yang , Wei Shen