English
Related papers

Related papers: Multi-Modal Dataset Creation for Federated Learnin…

200 papers

In clinics, a radiology report is crucial for guiding a patient's treatment. However, writing radiology reports is a heavy burden for radiologists. To this end, we present an automatic, multi-modal approach for report generation from a…

Image and Video Processing · Electrical Eng. & Systems 2022-06-02 Shuxin Yang , Xian Wu , Shen Ge , S. Kevin Zhou , Li Xiao

Labeling training datasets has become a key barrier to building medical machine learning models. One strategy is to generate training labels programmatically, for example by applying natural language processing pipelines to text reports…

Smart cars, smartphones and other devices in the Internet of Things (IoT), which usually have more than one sensors, produce multimodal data. Federated Learning supports collecting a wealth of multimodal data from different devices without…

Machine Learning · Computer Science 2022-09-08 Yulian Sun

In multicenter biomedical research, integrating data from multiple decentralized sites provides more robust and generalizable findings due to its larger sample size and the ability to account for the between-site heterogeneity. However,…

Methodology · Statistics 2025-12-29 Xiaokang Liu , Yuchen Yang , Yifei Sun , Jiang Bian , Yanyuan Ma , Raymond J. Carroll , Yong Chen

Recent progress in generative AI, primarily through diffusion models, presents significant challenges for real-world deepfake detection. The increased realism in image details, diverse content, and widespread accessibility to the general…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Chaitali Bhattacharyya , Hanxiao Wang , Feng Zhang , Sungho Kim , Xiatian Zhu

Digital textbooks are widely used in various educational contexts, such as university courses and online lectures. Such textbooks yield learning log data that have been used in numerous educational data mining (EDM) studies for student…

Machine Learning · Computer Science 2025-07-22 Shunsuke Yoneda , Valdemar Švábenský , Gen Li , Daisuke Deguchi , Atsushi Shimada

Federated learning (FL) enables collaborative model training across decentralized medical institutions while preserving data privacy. However, medical FL benchmarks remain scarce, with existing efforts focusing mainly on unimodal or bimodal…

Computer Vision and Pattern Recognition · Computer Science 2026-02-05 Aavash Chhetri , Bibek Niroula , Pratik Shrestha , Yash Raj Shrestha , Lesley A Anderson , Prashnna K Gyawali , Loris Bazzani , Binod Bhattarai

As medical diagnoses increasingly leverage multimodal data, machine learning models are expected to effectively fuse heterogeneous information while remaining robust to missing modalities. In this work, we propose a novel multimodal…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Yi Gu , Kuniaki Saito , Jiaxin Ma

Multimodal learning is a rapidly growing research field that has revolutionized multitasking and generative modeling in AI. While much of the research has focused on dealing with unstructured data (e.g., language, images, audio, or video),…

Artificial Intelligence · Computer Science 2024-03-11 Marco D Alessandro , Enrique Calabrés , Mikel Elkano

Biomedical data is inherently multimodal, consisting of electronic health records, medical imaging, digital pathology, genome sequencing, wearable sensors, and more. The application of artificial intelligence tools to these multifaceted…

Machine Learning · Computer Science 2024-08-26 Shentong Mo , Paul Pu Liang

The collection and curation of large-scale medical datasets from multiple institutions is essential for training accurate deep learning models, but privacy concerns often hinder data sharing. Federated learning (FL) is a promising solution…

Computer Vision and Pattern Recognition · Computer Science 2023-01-12 Rui Yan , Liangqiong Qu , Qingyue Wei , Shih-Cheng Huang , Liyue Shen , Daniel Rubin , Lei Xing , Yuyin Zhou

The clinical trial is a pivotal and costly process, often spanning multiple years and requiring substantial financial resources. Therefore, the development of clinical trial outcome prediction models aims to exclude drugs likely to fail and…

Machine Learning · Computer Science 2025-01-29 Wenhao Zheng , Liaoyaqi Wang , Dongshen Peng , Hongxia Xu , Yun Li , Hongtu Zhu , Tianfan Fu , Huaxiu Yao

Traditional model-based diagnosis relies on constructing explicit system models, a process that can be laborious and expertise-demanding. In this paper, we propose a novel framework that combines concepts of model-based diagnosis with deep…

Artificial Intelligence · Computer Science 2023-10-11 Jan Lukas Augustin , Oliver Niggemann

Federated learning is a learning paradigm to enable collaborative learning across different parties without revealing raw data. Notably, vertical federated learning (VFL), where parties share the same set of samples but only hold partial…

Machine Learning · Computer Science 2023-03-24 Zhaomin Wu , Qinbin Li , Bingsheng He

The use of machine learning (ML) for cancer staging through medical image analysis has gained substantial interest across medical disciplines. When accompanied by the innovative federated learning (FL) framework, ML techniques can further…

Machine Learning · Computer Science 2024-10-10 Kasra Borazjani , Naji Khosravan , Leslie Ying , Seyyedali Hosseinalipour

Artificial intelligence has emerged as a transformative tool in medical image analysis, yet developing robust and generalizable segmentation models remains difficult due to fragmented, privacy-constrained imaging data siloed across…

Computer Vision and Pattern Recognition · Computer Science 2026-02-25 Sachin Dudda Nagaraju , Ashkan Moradi , Bendik Skarre Abrahamsen , Mattijs Elschot

Semi-supervised multi-organ medical image segmentation aids physicians in improving disease diagnosis and treatment planning and reduces the time and effort required for organ annotation.Existing state-of-the-art methods train the labeled…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Haochen Zhao , Hui Meng , Deqian Yang , Xiaozheng Xie , Xiaoze Wu , Qingfeng Li , Jianwei Niu

One of the main challenges in current research on segmentation in cardiac ultrasound is the lack of large and varied labeled datasets and the differences in annotation conventions between datasets. This makes it difficult to design robust…

Image and Video Processing · Electrical Eng. & Systems 2025-02-28 Gilles Van De Vyver , Aksel Try Lenz , Erik Smistad , Sindre Hellum Olaisen , Bjørnar Grenne , Espen Holte , Håavard Dalen , Lasse Løvstakken

Medical imaging data plays a vital role in disease diagnosis, monitoring, and clinical research discovery. Biomedical data managers and clinical researchers must navigate a complex landscape of medical imaging infrastructure, input/output…

Multimodal medical imaging plays a pivotal role in clinical diagnosis and research, as it combines information from various imaging modalities to provide a more comprehensive understanding of the underlying pathology. Recently, deep…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 Yihao Li , Mostafa El Habib Daho , Pierre-Henri Conze , Rachid Zeghlache , Hugo Le Boité , Ramin Tadayoni , Béatrice Cochener , Mathieu Lamard , Gwenolé Quellec