English
Related papers

Related papers: Brain-DiT: A Universal Multi-state fMRI Foundation…

200 papers

Deep learning models have made significant advances in histological prediction tasks in recent years. However, for adaptation in clinical practice, their lack of robustness to varying conditions such as staining, scanner, hospital, and…

Image and Video Processing · Electrical Eng. & Systems 2025-06-23 David Jacob Drexlin , Jonas Dippel , Julius Hense , Niklas Prenißl , Grégoire Montavon , Frederick Klauschen , Klaus-Robert Müller

Masked diffusion models (MDM) are powerful generative models for discrete data that generate samples by progressively unmasking tokens in a sequence. Each token can take one of two states: masked or unmasked. We observe that token sequences…

Machine Learning · Computer Science 2025-10-23 Chen-Hao Chao , Wei-Fang Sun , Hanwen Liang , Chun-Yi Lee , Rahul G. Krishnan

Magnetic resonance imaging (MRI) and positron emission tomography (PET) are increasingly used in multimodal analysis of neurodegenerative disorders. While MRI is broadly utilized in clinical settings, PET is less accessible. Many studies…

Image and Video Processing · Electrical Eng. & Systems 2024-11-13 Minhui Yu , Mengqi Wu , Ling Yue , Andrea Bozoki , Mingxia Liu

MRI synthesis promises to mitigate the challenge of missing MRI modality in clinical practice. Diffusion model has emerged as an effective technique for image synthesis by modelling complex and variable data distributions. However, most…

Image and Video Processing · Electrical Eng. & Systems 2023-03-27 Lan Jiang , Ye Mao , Xi Chen , Xiangfeng Wang , Chao Li

We present a foundation model for brain MRI that can work with different combinations of imaging sequences. The model uses one encoder with learnable modality embeddings, conditional layer normalization, and a masked autoencoding objective…

Computer Vision and Pattern Recognition · Computer Science 2025-11-06 Minh Sao Khue Luu , Bair N. Tuchinov

Blind face restoration methods have shown remarkable performance, particularly when trained on large-scale synthetic datasets with supervised learning. These datasets are often generated by simulating low-quality face images with a…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Tianshu Kuai , Sina Honari , Igor Gilitschenski , Alex Levinshtein

Vision transformers (ViT) have shown promise in various vision tasks while the U-Net based on a convolutional neural network (CNN) remains dominant in diffusion models. We design a simple and general ViT-based architecture (named U-ViT) for…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Fan Bao , Shen Nie , Kaiwen Xue , Yue Cao , Chongxuan Li , Hang Su , Jun Zhu

Magnetic resonance imaging (MRI) is a vital diagnostic tool, but its inherently long acquisition times reduce clinical efficiency and patient comfort. Recent advancements in deep learning, particularly diffusion models, have improved…

Image and Video Processing · Electrical Eng. & Systems 2026-04-28 Yuxuan Zhang , Jinkui Hao , Bo Zhou

Stroke is a common disabling neurological condition that affects about one-quarter of the adult population over age 25; more than half of patients still have poor outcomes, such as permanent functional dependence or even death, after the…

Computer Vision and Pattern Recognition · Computer Science 2024-02-19 Chia-Ling Tsai , Hui-Yun Su , Shen-Feng Sung , Wei-Yang Lin , Ying-Ying Su , Tzu-Hsien Yang , Man-Lin Mai

Purpose: To accelerate MRI acquisition by incorporating the previous scans of a subject during reconstruction. Although longitudinal imaging constitutes much of clinical MRI, leveraging previous scans is challenging due to the complex…

Image and Video Processing · Electrical Eng. & Systems 2025-10-21 Yonatan Urman , Zachary Shah , Ashwin Kumar , Bruno P. Soares , Kawin Setsompop

Latent-space modeling has been the standard for Diffusion Transformers (DiTs). However, it relies on a two-stage pipeline where the pretrained autoencoder introduces lossy reconstruction, leading to error accumulation while hindering joint…

Computer Vision and Pattern Recognition · Computer Science 2026-04-17 Yongsheng Yu , Wei Xiong , Weili Nie , Yichen Sheng , Shiqiu Liu , Jiebo Luo

When deep learning models are sequentially trained on new data, they tend to abruptly lose performance on previously learned tasks, a critical failure known as catastrophic forgetting. This challenge severely limits the deployment of AI in…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Paraskevi-Antonia Theofilou , Anuhya Thota , Stefanos Kollias , Mamatha Thota

Introduction: Fetal resting-state functional magnetic resonance imaging (rs-fMRI) is a rapidly evolving field that provides valuable insight into brain development before birth. Accurate segmentation of the fetal brain from the surrounding…

Brain computer interface (BCI) research, as well as increasing portions of the field of neuroscience, have found success deploying large-scale artificial intelligence (AI) pre-training methods in conjunction with vast public repositories of…

Neurons and Cognition · Quantitative Biology 2025-06-03 Mattson Ogg , Rahul Hingorani , Diego Luna , Griffin W. Milsap , William G. Coon , Clara A. Scholl

Implicit visual knowledge in a large latent diffusion model (LLDM) pre-trained on natural images is rich and hypothetically universal to natural and medical images. To test this hypothesis from a practical perspective, we propose a novel…

Image and Video Processing · Electrical Eng. & Systems 2024-07-08 Ziqi Gao , S. Kevin Zhou

Head computed tomography (CT) imaging is a widely-used imaging modality with multitudes of medical indications, particularly in assessing pathology of the brain, skull, and cerebrovascular system. It is commonly the first-line imaging in…

This work asks: with abundant, unlabeled real faces, how to learn a robust and transferable facial representation that boosts various face security tasks with respect to generalization performance? We make the first attempt and propose a…

Computer Vision and Pattern Recognition · Computer Science 2025-10-10 Gaojian Wang , Feng Lin , Tong Wu , Zhenguang Liu , Zhongjie Ba , Kui Ren

Frontier artificial intelligence (AI) models, such as OpenAI's GPT-5 and Meta's DINOv3, have advanced rapidly through training on internet-scale public data, yet such systems lack access to private clinical data. Neuroimaging, in…

Magnetic Resonance Imaging (MRI) reconstruction is essential in medical diagnostics. As the latest generative models, diffusion models (DMs) have struggled to produce high-fidelity images due to their stochastic nature in image domains.…

Image and Video Processing · Electrical Eng. & Systems 2025-07-01 Lingtong Zhang , Mengdie Song , Xiaohan Hao , Huayu Mai , Bensheng Qiu

Longitudinal brain MRI is essential for lifespan study, yet high attrition rates often lead to missing data, complicating analysis. Deep generative models have been explored, but most rely solely on image intensity, leading to two key…

Computer Vision and Pattern Recognition · Computer Science 2026-01-22 Tianli Tao , Ziyang Wang , Delong Yang , Han Zhang , Le Zhang