English
Related papers

Related papers: A Modality-agnostic Multi-task Foundation Model fo…

200 papers

Generalizability in deep neural networks plays a pivotal role in medical image segmentation. However, deep learning-based medical image analyses tend to overlook the importance of frequency variance, which is critical element for achieving…

Image and Video Processing · Electrical Eng. & Systems 2024-05-13 Ju-Hyeon Nam , Nur Suriza Syazwany , Su Jung Kim , Sang-Chul Lee

Decoding motor imagery (MI) electroencephalogram (EEG) signals, a key non-invasive brain-computer interface (BCI) paradigm for controlling external systems, has been significantly advanced by deep learning. However, cross-subject MI-EEG…

Machine Learning · Computer Science 2026-03-26 Jinzhou Wu , Baoping Tang , Qikang Li , Yi Wang , Cheng Li , Shujian Yu

Accurate brain tumor diagnosis relies on the assessment of multiple Magnetic Resonance Imaging (MRI) sequences. However, in clinical practice, the acquisition of certain sequences may be affected by factors like motion artifacts or contrast…

Image and Video Processing · Electrical Eng. & Systems 2025-05-30 Moinak Bhattacharya , Saumya Gupta , Annie Singh , Chao Chen , Gagandeep Singh , Prateek Prasanna

Objective: Multi-modal functional magnetic resonance imaging (fMRI) can be used to make predictions about individual behavioral and cognitive traits based on brain connectivity networks. Methods: To take advantage of complementary…

Machine Learning · Computer Science 2024-08-27 Gang Qu , Li Xiao , Wenxing Hu , Kun Zhang , Vince D. Calhoun , Yu-Ping Wang

The Unconstrained Feature Model (UFM) is a mathematical framework that enables closed-form approximations for minimal training loss and related performance measures in deep neural networks (DNNs). This paper leverages the UFM to provide…

Machine Learning · Computer Science 2025-10-01 George Andriopoulos , Soyuj Jung Basnet , Juan Guevara , Li Guo , Keith Ross

Recent advances in MRI have led to the creation of large datasets. With the increase in data volume, it has become difficult to locate previous scans of the same patient within these datasets (a process known as re-identification). To…

Image and Video Processing · Electrical Eng. & Systems 2023-09-26 Lemuel Puglisi , Frederik Barkhof , Daniel C. Alexander , Geoffrey JM Parker , Arman Eshaghi , Daniele Ravì

Deep learning-based brain tumor segmentation (BTS) models for multi-modal MRI images have seen significant advancements in recent years. However, a common problem in practice is the unavailability of some modalities due to varying scanning…

Computer Vision and Pattern Recognition · Computer Science 2024-06-17 Weide Liu , Jingwen Hou , Xiaoyang Zhong , Huijing Zhan , Jun Cheng , Yuming Fang , Guanghui Yue

Recent advancements in the acquisition of various brain data sources have created new opportunities for integrating multimodal brain data to assist in early detection of complex brain disorders. However, current data integration approaches…

Image and Video Processing · Electrical Eng. & Systems 2023-05-26 Reza Shirkavand , Liang Zhan , Heng Huang , Li Shen , Paul M. Thompson

Accurate brain tumor segmentation from Magnetic Resonance Imaging (MRI) is desirable to joint learning of multimodal images. However, in clinical practice, it is not always possible to acquire a complete set of MRIs, and the problem of…

Image and Video Processing · Electrical Eng. & Systems 2022-08-05 Yao Zhang , Nanjun He , Jiawei Yang , Yuexiang Li , Dong Wei , Yawen Huang , Yang Zhang , Zhiqiang He , Yefeng Zheng

Previous studies have shown that it is possible to map brain activation data of subjects viewing images onto the feature representation space of not only vision models (modality-specific decoding) but also language models (cross-modal…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Mitja Nikolaus , Milad Mozafari , Nicholas Asher , Leila Reddy , Rufin VanRullen

Self-supervised pretrain techniques have been widely used to improve the downstream tasks' performance. However, real-world magnetic resonance (MR) studies usually consist of different sets of contrasts due to different acquisition…

Image and Video Processing · Electrical Eng. & Systems 2025-06-17 Badhan Kumar Das , Ajay Singh , Gengyan Zhao , Han Liu , Thomas J. Re , Dorin Comaniciu , Eli Gibson , Andreas Maier

Multi-view clustering has wide applications in many image processing scenarios. In these scenarios, original image data often contain missing instances and noises, which is ignored by most multi-view clustering methods. However, missing…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Xiang Fang , Yuchong Hu , Pan Zhou , Dapeng Oliver Wu

Artificial intelligence (AI) is vital in ophthalmology, tackling tasks like diagnosis, classification, and visual question answering (VQA). However, existing AI models in this domain often require extensive annotation and are task-specific,…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Danli Shi , Weiyi Zhang , Xiaolan Chen , Yexin Liu , Jiancheng Yang , Siyu Huang , Yih Chung Tham , Yingfeng Zheng , Mingguang He

Visual anomaly detection aims to learn normality from normal images, but existing approaches are fragmented across various tasks: defect detection, semantic anomaly detection, multi-class anomaly detection, and anomaly clustering. This…

Computer Vision and Pattern Recognition · Computer Science 2023-11-15 Yujin Lee , Harin Lim , Seoyoon Jang , Hyunsoo Yoon

While foundation models in radiology are expected to be applied to various clinical tasks, computational cost constraints remain a major challenge when training on 3D-CT volumetric data. In this study, we propose TotalFM, a radiological…

Computer Vision and Pattern Recognition · Computer Science 2026-01-05 Kohei Yamamoto , Tomohiro Kikuchi

Foundation models (FMs) are changing the way medical images are analyzed by learning from large collections of unlabeled data. Instead of relying on manually annotated examples, FMs are pre-trained to learn general-purpose visual features…

Accurate segmentation of brain images typically requires the integration of complementary information from multiple image modalities. However, clinical data for all modalities may not be available for every patient, creating a significant…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Haitao Li , Ziyu Li , Yiheng Mao , Zhengyao Ding , Zhengxing Huang

Recent studies have shown that multi-modeling methods can provide new insights into the analysis of brain components that are not possible when each modality is acquired separately. The joint representations of different modalities is a…

Neurons and Cognition · Quantitative Biology 2022-01-24 Jalal Mirakhorli

Brain network analysis has emerged as pivotal method for gaining a deeper understanding of brain functions and disease mechanisms. Despite the existence of various network construction approaches, shortcomings persist in the learning of…

Computer Vision and Pattern Recognition · Computer Science 2023-11-10 Yongcheng Zong , Shuqiang Wang

Electroencephalography foundation models (EEG-FMs) have advanced brain signal analysis, but the lack of standardized evaluation benchmarks impedes model comparison and scientific progress. Current evaluations rely on inconsistent protocols…

Signal Processing · Electrical Eng. & Systems 2026-02-16 Wei Xiong , Jiangtong Li , Jie Li , Kun Zhu , Changjun Jiang