English
Related papers

Related papers: A Generative Foundation Model for Multimodal Histo…

200 papers

While multiplex immunofluorescence (mIF) imaging provides deep, spatially-resolved molecular data, integrating this information with the morphological standard of Hematoxylin & Eosin (H&E) can be very important for obtaining complementary…

Quantitative Methods · Quantitative Biology 2025-08-08 Jillur Rahman Saurav , Mohammad Sadegh Nasr , Jacob M. Luber

Recent advancements in foundation models, typically trained with self-supervised learning on large-scale and diverse datasets, have shown great potential in medical image analysis. However, due to the significant spatial heterogeneity of…

Computer Vision and Pattern Recognition · Computer Science 2024-01-25 Lingxiao Luo , Xuanzhong Chen , Bingda Tang , Xinsheng Chen , Rong Han , Chengpeng Hu , Yujiang Li , Ting Chen

Incomplete data are common in real-world tabular applications, where numerical, categorical, and discrete attributes coexist within a single dataset. This heterogeneous structure presents significant challenges for existing diffusion-based…

Machine Learning · Computer Science 2025-11-19 Youran Zhou , Mohamed Reda Bouadjenek , Sunil Aryal

Unsupervised anomaly detection has gained significant attention in the field of medical imaging due to its capability of relieving the costly pixel-level annotation. To achieve this, modern approaches usually utilize generative models to…

Image and Video Processing · Electrical Eng. & Systems 2024-01-22 Rui Xu , Yunke Wang , Bo Du

Cross-modal medical image synthesis research focuses on reconstructing missing imaging modalities from available ones to support clinical diagnosis. Driven by clinical necessities for flexible modality reconstruction, we explore K to N…

Computer Vision and Pattern Recognition · Computer Science 2025-10-06 Feng Yuan , Yifan Gao , Yuehua Ye , Haoyue Li , Xin Gao

Medical multi-modal pre-training has revealed promise in computer-aided diagnosis by leveraging large-scale unlabeled datasets. However, existing methods based on masked autoencoders mainly rely on data-level reconstruction tasks, but lack…

Computer Vision and Pattern Recognition · Computer Science 2024-04-10 Yupei Zhang , Li Pan , Qiushi Yang , Tan Li , Zhen Chen

Artificial intelligence has started to transform histopathology impacting clinical diagnostics and biomedical research. However, while many computational pathology approaches have been proposed, most current AI models are limited with…

MultiPUFFIN is a domain-informed multimodal foundation model for predicting thermophysical properties of small molecules, addressing a critical gap in chemical engineering, drug discovery, and materials science. Existing molecular…

In Recent Years, Digital Technologies Have Made Significant Strides In Augmenting-Human-Health, Cognition, And Perception, Particularly Within The Field Of Computational-Pathology. This Paper Presents A Novel Approach To Enhancing The…

Computer Vision and Pattern Recognition · Computer Science 2025-07-24 Xiaoqian Hu

Diffusion models have become a central tool in deep generative modeling, but standard formulations rely on a single network and a single diffusion schedule to transform a simple prior, typically a standard normal distribution, into the…

Machine Learning · Statistics 2025-12-29 Takuro Kutsuna

Digital pathology has fundamentally altered diagnostic workflows by enabling the computational analysis of gigapixel Whole Slide Images (WSIs), yet effectively deciphering their complex tumor microenvironments remains a formidable…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Xuemei Qiu , Dawei Fan , Yebin Huang , Yanping Chen , Lifang Wei

Imaging-derived phenotypes (IDPs) summarize multi-organ physiology but provide only static snapshots of diseases that evolve over time. In contrast, longitudinal electronic health records encode disease trajectories through temporal…

Information Retrieval · Computer Science 2026-05-13 Zian Wang , Lizhen Lan , Guangming Wang , Haosen Zhang , Minxuan Xu , Qing Li , Tianxing He , Mo Yang , Wenyue Mao , Yajing Zhang , Yan Li , Chengyan Wang

Diffusion models have enabled remarkably high-quality medical image generation, yet it is challenging to enforce anatomical constraints in generated images. To this end, we propose a diffusion model-based method that supports…

Image and Video Processing · Electrical Eng. & Systems 2024-06-21 Nicholas Konz , Yuwen Chen , Haoyu Dong , Maciej A. Mazurowski

Routine clinical visits of a patient produce not only image data, but also non-image data containing clinical information regarding the patient, i.e., medical data is multi-modal in nature. Such heterogeneous modalities offer different and…

Computer Vision and Pattern Recognition · Computer Science 2023-03-16 Sein Kim , Namkyeong Lee , Junseok Lee , Dongmin Hyun , Chanyoung Park

Availability of large and diverse medical datasets is often challenged by privacy and data sharing restrictions. For successful application of machine learning techniques for disease diagnosis, prognosis, and precision medicine, large…

Artificial intelligence (AI) is vital in ophthalmology, tackling tasks like diagnosis, classification, and visual question answering (VQA). However, existing AI models in this domain often require extensive annotation and are task-specific,…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Danli Shi , Weiyi Zhang , Xiaolan Chen , Yexin Liu , Jiancheng Yang , Siyu Huang , Yih Chung Tham , Yingfeng Zheng , Mingguang He

Self-supervised learning has proved effective for skeleton-based human action understanding. However, previous works either rely on contrastive learning that suffers false negative problems or are based on reconstruction that learns too…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Lehong Wu , Lilang Lin , Jiahang Zhang , Yiyang Ma , Jiaying Liu

Cell detection, segmentation and classification are essential for analyzing tumor microenvironments (TME) on hematoxylin and eosin (H&E) slides. Existing methods suffer from poor performance on understudied cell types (rare or not present…

In recent years, computational pathology has seen tremendous progress driven by deep learning methods in segmentation and classification tasks aiding prognostic and diagnostic settings. Nuclei segmentation, for instance, is an important…

Image and Video Processing · Electrical Eng. & Systems 2023-03-22 Aman Shrivastava , P. Thomas Fletcher

Clinical diagnostic decision making and population-based studies often rely on multi-modal data which is noisy and incomplete. Recently, several works proposed geometric deep learning approaches to solve disease classification, by modeling…

Machine Learning · Computer Science 2019-05-09 Gerome Vivar , Hendrik Burwinkel , Anees Kazi , Andreas Zwergal , Nassir Navab , Seyed-Ahmad Ahmadi