English
Related papers

Related papers: Repurposing Foundation Model for Generalizable Med…

200 papers

Recent advancements in foundation models, typically trained with self-supervised learning on large-scale and diverse datasets, have shown great potential in medical image analysis. However, due to the significant spatial heterogeneity of…

Computer Vision and Pattern Recognition · Computer Science 2024-01-25 Lingxiao Luo , Xuanzhong Chen , Bingda Tang , Xinsheng Chen , Rong Han , Chengpeng Hu , Yujiang Li , Ting Chen

Time series analysis stands as a focal point within the data mining community, serving as a cornerstone for extracting valuable insights crucial to a myriad of real-world applications. Recent advances in Foundation Models (FMs) have…

Machine Learning · Computer Science 2024-06-19 Yuxuan Liang , Haomin Wen , Yuqi Nie , Yushan Jiang , Ming Jin , Dongjin Song , Shirui Pan , Qingsong Wen

Federated learning enables multiple hospitals to cooperatively learn a shared model without privacy disclosure. Existing methods often take a common assumption that the data from different hospitals have the same modalities. However, such a…

Image and Video Processing · Electrical Eng. & Systems 2023-06-06 Yunlu Yan , Hong Wang , Yawen Huang , Nanjun He , Lei Zhu , Yuexiang Li , Yong Xu , Yefeng Zheng

Time series anomaly detection forms a very crucial area in several domains but poses substantial challenges. Due to time series data possessing seasonality, trends, noise, and evolving patterns (concept drift), it becomes very difficult to…

Machine Learning · Computer Science 2025-10-07 Yadav Mahesh Lorik , Kaushik Sarveswaran , Nagaraj Sundaramahalingam , Aravindakumar Venugopalan

Time series foundation models are pre-trained on large datasets and are able to achieve state-of-the-art performance in diverse tasks. However, to date, there has been limited work demonstrating how well these models perform in medical…

Machine Learning · Computer Science 2024-11-21 Mingzhu Liu , Angela H. Chen , George H. Chen

Learning meaningful representations from medical time series (MedTS) such as ECG or EEG signals is a critical challenge. These signals are often high-dimensional, variable-length and rife with noise. Existing self-supervised approaches,…

Machine Learning · Computer Science 2026-05-04 Huayu Li , ZhengXiao He , Xiwen Chen , Jingjing Wang , Siyuan Tian , Jinghao Wen , Ao Li

Deep learning-based methods have achieved encouraging performances in the field of magnetic resonance (MR) image reconstruction. Nevertheless, to properly learn a powerful and robust model, these methods generally require large quantities…

Image and Video Processing · Electrical Eng. & Systems 2023-04-18 Ruoyou Wu , Cheng Li , Juan Zou , Qiegen Liu , Hairong Zheng , Shanshan Wang

Medical text embedding models are foundational to a wide array of healthcare applications, ranging from clinical decision support and biomedical information retrieval to medical question answering, yet they remain hampered by two critical…

Computation and Language · Computer Science 2025-08-07 Mohammad Khodadad , Ali Shiraee Kasmaee , Mahdi Astaraki , Hamidreza Mahyar

In this study, we aim to initiate the development of Radiology Foundation Model, termed as RadFM. We consider the construction of foundational models from three perspectives, namely, dataset construction, model design, and thorough…

Computer Vision and Pattern Recognition · Computer Science 2023-11-17 Chaoyi Wu , Xiaoman Zhang , Ya Zhang , Yanfeng Wang , Weidi Xie

Foundation models (FMs) are changing the way medical images are analyzed by learning from large collections of unlabeled data. Instead of relying on manually annotated examples, FMs are pre-trained to learn general-purpose visual features…

Foundation models (FMs) have demonstrated strong transferability across medical imaging tasks, yet their clinical utility depends critically on how pretrained representations are adapted to domain-specific data, supervision regimes, and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Karma Phuntsho , Abdullah , Kyungmi Lee , Ickjai Lee , Euijoon Ahn

Medical time series, such as electrocardiograms (ECG) and electroencephalograms (EEG), exhibit complex temporal dynamics and structured cross-channel dependencies, posing fundamental challenges for automated analysis. Conventional…

Signal Processing · Electrical Eng. & Systems 2026-05-08 ZhengXiao He , Huayu Li , Xiwen Chen , Janet M Roveda , Jinghao Wen , Siyuan Tian , Ao Li

Time series analysis is widely used in extensive areas. Recently, to reduce labeling expenses and benefit various tasks, self-supervised pre-training has attracted immense interest. One mainstream paradigm is masked modeling, which…

Machine Learning · Computer Science 2023-10-24 Jiaxiang Dong , Haixu Wu , Haoran Zhang , Li Zhang , Jianmin Wang , Mingsheng Long

Foundation models (FMs) are transforming computational pathology by offering new ways to analyze histopathology images. However, FMs typically require weeks of training on large databases, making their creation a resource-intensive process.…

Image and Video Processing · Electrical Eng. & Systems 2026-01-27 Till Nicke , Daniela Schacherer , Jan Raphael Schäfer , Natalia Artysh , Antje Prasse , André Homeyer , Andrea Schenk , Henning Höfener , Johannes Lotz

The advent of large-scale self-supervised learning (SSL) has produced a vast zoo of medical foundation models. However, selecting optimal medical foundation models for specific segmentation tasks remains a computational bottleneck. Existing…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Jiaqi Tang , Shaoyang Zhang , Xiaoqi Wang , Jiaying Zhou , Yang Liu , Qingchao Chen

Foundation models (FMs) such as CLIP and SAM have recently shown great promise in image segmentation tasks, yet their adaptation to 3D medical imaging-particularly for pathology detection and segmentation-remains underexplored. A critical…

Image and Video Processing · Electrical Eng. & Systems 2025-08-28 Sirui Li , Linkai Peng , Zheyuan Zhang , Gorkem Durak , Ulas Bagci

Foundation models (FMs) promise to generalize medical imaging, but their effectiveness varies. It remains unclear how pre-training domain (medical vs. general), paradigm (e.g., text-guided), and architecture influence embedding quality,…

Hospitals and healthcare systems rely on operational decisions that determine patient flow, cost, and quality of care. Despite strong performance on medical knowledge and conversational benchmarks, foundation models trained on general text…

Domain-specific foundation models for healthcare have expanded rapidly in recent years, yet foundation models for critical care time series remain relatively underexplored due to the limited size and availability of datasets. In this work,…

Machine Learning · Computer Science 2025-09-25 Katja Naasunnguaq Jagd , Rachael DeVries , Ole Winther

Time series foundation models (TSFMs) are revolutionizing the forecasting landscape from specific dataset modeling to generalizable task evaluation. However, we contend that existing benchmarks exhibit common limitations in four dimensions:…