English
Related papers

Related papers: Towards Generalisable Foundation Models for Brain …

200 papers

Affine image registration is a cornerstone of medical image analysis. While classical algorithms can achieve excellent accuracy, they solve a time-consuming optimization for every image pair. Deep-learning (DL) methods learn a function that…

Image and Video Processing · Electrical Eng. & Systems 2024-07-15 Malte Hoffmann , Andrew Hoopes , Douglas N. Greve , Bruce Fischl , Adrian V. Dalca

Functional magnetic resonance imaging (fMRI) is a powerful tool for investigating human brain function. However, the high cost of data acquisition and the inherent subjectivity of psychiatric rating scales often lead to datasets with small…

Machine Learning · Computer Science 2026-05-29 Jiyao Wang , Peiyu Duan , Nicha C. Dvornek , Lawrence H. Staib , Denis Sukhodolsky , Pamela Ventola , James S. Duncan

Schizophrenia is a chronic neuropsychiatric disorder that causes distinct structural alterations within the brain. We hypothesize that deep learning applied to a structural neuroimaging dataset could detect disease-related alteration and…

Image and Video Processing · Electrical Eng. & Systems 2022-07-08 Junhao Zhang , Vishwanatha M. Rao , Ye Tian , Yanting Yang , Nicolas Acosta , Zihan Wan , Pin-Yu Lee , Chloe Zhang , Lawrence S. Kegeles , Scott A. Small , Jia Guo

The human brain is a complex system requiring both macroscopic and microscopic components for comprehensive understanding. However, mapping nonlinear relationships between these scales remains challenging due to technical limitations and…

Image and Video Processing · Electrical Eng. & Systems 2025-10-28 Sooyoung Kim , Joonwoo Kwon , Junbeom Kwon , Jungyoun Janice Min , Sangyoon Bae , Yuewei Lin , Shinjae Yoo , Jiook Cha

Artificial intelligence (AI) is evolving towards artificial general intelligence, which refers to the ability of an AI system to perform a wide range of tasks and exhibit a level of intelligence similar to that of a human being. This is in…

Computer Vision and Pattern Recognition · Computer Science 2023-05-22 Chunhui Zhang , Li Liu , Yawen Cui , Guanjie Huang , Weilin Lin , Yiqian Yang , Yuehong Hu

Many AI models trained on natural images develop representations that resemble those of the human brain. However, the factors that drive this brain-model similarity remain poorly understood. To disentangle how the model, training and data…

Artificial Intelligence · Computer Science 2025-08-26 Joséphine Raugel , Marc Szafraniec , Huy V. Vo , Camille Couprie , Patrick Labatut , Piotr Bojanowski , Valentin Wyart , Jean-Rémi King

Multimodal medical image fusion helps in combining contrasting features from two or more input imaging modalities to represent fused information in a single image. One of the pivotal clinical applications of medical image fusion is the…

Image and Video Processing · Electrical Eng. & Systems 2019-09-20 Nishant Kumar , Nico Hoffmann , Martin Oelschlägel , Edmund Koch , Matthias Kirsch , Stefan Gumhold

Recent advancements in medical image segmentation techniques have achieved compelling results. However, most of the widely used approaches do not take into account any prior knowledge about the shape of the biomedical structures being…

Image and Video Processing · Electrical Eng. & Systems 2019-09-18 Zhou He , Siqi Bao , Albert Chung

We present VisionFM, a foundation model pre-trained with 3.4 million ophthalmic images from 560,457 individuals, covering a broad range of ophthalmic diseases, modalities, imaging devices, and demography. After pre-training, VisionFM…

Registration of brain MRI images requires to solve a deformation field, which is extremely difficult in aligning intricate brain tissues, e.g., subcortical nuclei, etc. Existing efforts resort to decomposing the target deformation field…

Image and Video Processing · Electrical Eng. & Systems 2022-04-27 Jinxin Lv , Zhiwei Wang , Hongkuan Shi , Haobo Zhang , Sheng Wang , Yilang Wang , Qiang Li

Deformable registration is a fundamental task in medical image processing, aiming to achieve precise alignment by establishing nonlinear correspondences between images. Traditional methods offer good adaptability and interpretability but…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 Jing Hu , Kaiwei Yu , Hongjiang Xian , Shu Hu , Xin Wang

Face Anti-Spoofing (FAS) remains challenging due to the requirement for robust domain generalization across unseen environments. While recent trends leverage Vision-Language Models (VLMs) for semantic supervision, these multimodal…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Mika Feng , Pierre Gallin-Martel , Koichi Ito , Takafumi Aoki

The advent of foundation models (FMs) is transforming medical domain. In ophthalmology, RETFound, a retina-specific FM pre-trained sequentially on 1.4 million natural images and 1.6 million retinal images, has demonstrated high adaptability…

The global population is aging rapidly, and aging is a major risk factor for various diseases. It is an important task to predict how each individual's brain will age, as the brain supports many human functions. This capability can greatly…

Neurons and Cognition · Quantitative Biology 2025-12-05 Yifan Li , Javad Sohankar , Ji Luo , Jing Li , Yi Su

Electroencephalography provides a non-invasive window into brain activity, offering valuable insights for neurological research, brain-computer interfaces, and clinical diagnostics. However, the development of robust machine learning models…

Signal Processing · Electrical Eng. & Systems 2025-02-26 Chi-Sheng Chen , Ying-Jung Chen , Aidan Hung-Wen Tsai

Foundation models (FMs) have emerged as a transformative paradigm in medical image analysis, offering the potential to provide generalizable, task-agnostic solutions across a wide range of clinical tasks and imaging modalities. Their…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Karma Phuntsho , Abdullah , Kyungmi Lee , Ickjai Lee , Euijoon Ahn

We propose a registration algorithm for 2D CT/MRI medical images with a new unsupervised end-to-end strategy using convolutional neural networks. The contributions of our algorithm are threefold: (1) We transplant traditional image…

Computer Vision and Pattern Recognition · Computer Science 2018-01-23 Siyuan Shan , Wen Yan , Xiaoqing Guo , Eric I-Chao Chang , Yubo Fan , Yan Xu

Current medical vision-language models (VLMs) process volumetric brain MRI using 2D slice-based approximations, fragmenting the spatial context required for accurate neuroradiological interpretation. We developed \textbf{Brain3D}, a staged…

Computer Vision and Pattern Recognition · Computer Science 2026-02-26 Mariano Barone , Francesco Di Serio , Giuseppe Riccio , Antonio Romano , Marco Postiglione , Antonino Ferraro , Vincenzo Moscato

Electroencephalography (EEG) signals are known to manifest differential patterns when individuals visually concentrate on different objects. In this work, we present an end-to-end digital fabrication system, Brain2Object, to print the 3D…

Human-Computer Interaction · Computer Science 2020-06-18 Xiang Zhang , Lina Yao , Chaoran Huang , Salil S. Kanhere , Dalin Zhang , Yu Zhang

Foundation models have exhibited remarkable success in various applications, such as disease diagnosis and text report generation. To date, a foundation model for endoscopic video analysis is still lacking. In this paper, we propose…

Computer Vision and Pattern Recognition · Computer Science 2024-01-10 Zhao Wang , Chang Liu , Shaoting Zhang , Qi Dou