English
Related papers

Related papers: A Modality-agnostic Multi-task Foundation Model fo…

200 papers

Artificial intelligence (AI) has become a fundamental tool for assisting clinicians in analyzing ophthalmic images, such as optical coherence tomography (OCT). However, developing AI models often requires extensive annotation, and existing…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 José Morano , Botond Fazekas , Emese Sükei , Ronald Fecso , Taha Emre , Markus Gumpinger , Georg Faustmann , Marzieh Oghbaie , Ursula Schmidt-Erfurth , Hrvoje Bogunović

The scarcity of annotated medical images is a major bottleneck in developing learning models for medical image analysis. Hence, recent studies have focused on pretrained models with fewer annotation requirements that can be fine-tuned for…

Image and Video Processing · Electrical Eng. & Systems 2024-10-02 Jonghun Kim , Mansu Kim , Hyunjin Park

Establishing dense anatomical correspondence across distinct imaging modalities is a foundational yet challenging procedure for numerous medical image analysis studies and image-guided radiotherapy. Existing multi-modality image…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Tony C. W. Mok , Zi Li , Yunhao Bai , Jianpeng Zhang , Wei Liu , Yan-Jie Zhou , Ke Yan , Dakai Jin , Yu Shi , Xiaoli Yin , Le Lu , Ling Zhang

Human activity recognition serves as the foundation for various emerging applications. In recent years, researchers have used collaborative sensing of multi-source sensors to capture complex and dynamic human activities. However, multimodal…

Machine Learning · Computer Science 2026-04-28 Long Jing , Zhixiong Yang , Yajun Zhang , Xinlong Feng

This work focuses on 3D Radar imaging inverse problems. Current methods obtain undifferentiated results that suffer task-depended information retrieval loss and thus don't meet the task's specific demands well. For example, biased…

Signal Processing · Electrical Eng. & Systems 2022-11-29 Xu Zhan , Xiaoling Zhang , Mou Wang , Jun Shi , Shunjun Wei , Tianjiao Zeng

Foundation models are transforming neuroscience but are often prohibitively large, data-hungry, and difficult to deploy. Here, we introduce BrainSymphony, a lightweight and parameter-efficient foundation model with plug-and-play integration…

Quantitative Methods · Quantitative Biology 2026-02-13 Moein Khajehnejad , Forough Habibollahi , Devon Stoliker , Adeel Razi

Image modality recognition is essential for efficient imaging workflows in current clinical environments, where multiple imaging modalities are used to better comprehend complex diseases. Emerging biomarkers from novel, rare modalities are…

Computer Vision and Pattern Recognition · Computer Science 2019-08-28 Santi Puch , Irina Sánchez , Matt Rowe

Brain decoding aims to reconstruct visual perception of human subject from fMRI signals, which is crucial for understanding brain's perception mechanisms. Existing methods are confined to the single-subject paradigm due to substantial brain…

Computer Vision and Pattern Recognition · Computer Science 2025-02-10 Yuqin Dai , Zhouheng Yao , Chunfeng Song , Qihao Zheng , Weijian Mai , Kunyu Peng , Shuai Lu , Wanli Ouyang , Jian Yang , Jiamin Wu

The successful adaptation of foundation models to multi-modal medical imaging is a critical yet unresolved challenge. Existing models often struggle to effectively fuse information from multiple sources and adapt to the heterogeneous nature…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Shadi Alijani , Fereshteh Aghaee Meibodi , Homayoun Najjaran

Registration of brain scans with pathologies is difficult, yet important research area. The importance of this task motivated researchers to organize the BraTS-Reg challenge, jointly with IEEE ISBI 2022 and MICCAI 2022 conferences. The…

Computer Vision and Pattern Recognition · Computer Science 2024-05-22 Marek Wodzinski , Artur Jurgas , Niccolo Marini , Manfredo Atzori , Henning Muller

Understanding how the brain represents visual information is a fundamental challenge in neuroscience and artificial intelligence. While AI-driven decoding of neural data has provided insights into the human visual system, integrating…

Neural and Evolutionary Computing · Computer Science 2025-10-07 Dongyang Li , Haoyang Qin , Mingyang Wu , Chen Wei , Quanying Liu

Pain is a manifold condition that impacts a significant percentage of the population. Accurate and reliable pain evaluation for the people suffering is crucial to developing effective and advanced pain management protocols. Automatic pain…

Computer Vision and Pattern Recognition · Computer Science 2025-10-10 Stefanos Gkikas , Raul Fernandez Rojas , Manolis Tsiknakis

Aggregating multi-subject functional magnetic resonance imaging (fMRI) data is indispensable for generating valid and general inferences from patterns distributed across human brains. The disparities in anatomical structures and functional…

Machine Learning · Computer Science 2019-11-20 Weida Li , Mingxia Liu , Fang Chen , Daoqiang Zhang

Multi-slice magnetic resonance images of the fetal brain are usually contaminated by severe and arbitrary fetal and maternal motion. Hence, stable and robust motion correction is necessary to reconstruct high-resolution 3D fetal brain…

Image and Video Processing · Electrical Eng. & Systems 2022-09-23 Wen Shi , Haoan Xu , Cong Sun , Jiwei Sun , Yamin Li , Xinyi Xu , Tianshu Zheng , Yi Zhang , Guangbin Wang , Dan Wu

Accurately monitoring cognitive load in real time is critical for Brain-Computer Interfaces (BCIs) that adapt to user engagement and support personalized learning. Electroencephalography (EEG) offers a non-invasive, cost-effective modality…

Human-Computer Interaction · Computer Science 2026-05-04 Deeksha M. Shama , Dimitra Emmanouilidou , Ivan J. Tashev

Medical data poses a daunting challenge for AI algorithms: it exists in many different modalities, experiences frequent distribution shifts, and suffers from a scarcity of examples and labels. Recent advances, including transformers and…

Many real-world settings require registration of a pair of medical images that differ in spatial resolution, which may arise from differences in image acquisition parameters like pixel spacing, slice thickness, and field-of-view. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Mina C. Moghadam , Alan Q. Wang , Omer Taub , Martin R. Prince , Mert R. Sabuncu

In MRI-based mental disorder diagnosis, most previous studies focus on functional connectivity network (FCN) derived from functional MRI (fMRI). However, the small size of annotated fMRI datasets restricts its wide application. Meanwhile,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-07 Xingcan Hu , Wei Wang , Li Xiao

Inadequate generality across different organs and tasks constrains the application of ultrasound (US) image analysis methods in smart healthcare. Building a universal US foundation model holds the potential to address these issues.…

Image and Video Processing · Electrical Eng. & Systems 2024-01-03 Jing Jiao , Jin Zhou , Xiaokang Li , Menghua Xia , Yi Huang , Lihong Huang , Na Wang , Xiaofan Zhang , Shichong Zhou , Yuanyuan Wang , Yi Guo

Leading approaches in machine vision employ different architectures for different tasks, trained on costly task-specific labeled datasets. This complexity has held back progress in areas, such as robotics, where robust task-general…

Computer Vision and Pattern Recognition · Computer Science 2023-06-06 Daniel M. Bear , Kevin Feigelis , Honglin Chen , Wanhee Lee , Rahul Venkatesh , Klemen Kotar , Alex Durango , Daniel L. K. Yamins