English
Related papers

Related papers: A Generative Foundation Model for Multimodal Histo…

200 papers

In pathology, tissue samples are assessed using multiple staining techniques to enhance contrast in unique histologic features. In this paper, we introduce a multimodal CNN-GNN based graph fusion approach that leverages complementary…

Image and Video Processing · Electrical Eng. & Systems 2022-04-28 Chaitanya Dwivedi , Shima Nofallah , Maryam Pouryahya , Janani Iyer , Kenneth Leidal , Chuhan Chung , Timothy Watkins , Andrew Billin , Robert Myers , John Abel , Ali Behrooz

Deep learning techniques have become widely utilized in histopathology image classification due to their superior performance. However, this success heavily relies on the availability of substantial labeled data, which necessitates…

Image and Video Processing · Electrical Eng. & Systems 2024-10-15 Meng Li , Chaoyi Li , Can Peng , Brian C. Lovell

Currently, a central challenge and bottleneck in the deployment and validation of computer-aided diagnosis (CAD) models within the field of medical imaging is data scarcity. For lung cancer, one of the most prevalent types worldwide,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 António Cardoso , Pedro Sousa , Tania Pereira , Hélder P. Oliveira

The Skinned Multi-Person Linear (SMPL) model plays a crucial role in 3D human pose estimation, providing a streamlined yet effective representation of the human body. However, ensuring the validity of SMPL configurations during tasks such…

Computer Vision and Pattern Recognition · Computer Science 2024-10-21 Calvin-Khang Ta , Arindam Dutta , Rohit Kundu , Rohit Lal , Hannah Dela Cruz , Dripta S. Raychaudhuri , Amit Roy-Chowdhury

Deep learning is widely applied in computer-aided pathological diagnosis, which alleviates the pathologist workload and provide timely clinical analysis. However, most models generally require large-scale annotated data for training, which…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Zeyu Liu , Tianyi Zhang , Yufang He , Yunlu Feng , Yu Zhao , Guanglei Zhang

Multiplex imaging is revolutionizing pathology by enabling the simultaneous visualization of multiple biomarkers within tissue samples, providing molecular-level insights that traditional hematoxylin and eosin (H&E) staining cannot provide.…

Image and Video Processing · Electrical Eng. & Systems 2026-01-06 Hyun-Jic Oh , Junsik Kim , Zhiyi Shi , Yichen Wu , Yu-An Chen , Peter K Sorger , Hanspeter Pfister , Won-Ki Jeong

Histopathologic diagnosis relies on simultaneous integration of information from a broad range of scales, ranging from nuclear aberrations ($\approx \mathcal{O}(0.1{\mu m})$) through cellular structures ($\approx \mathcal{O}(10{\mu m})$) to…

Image and Video Processing · Electrical Eng. & Systems 2021-02-23 Rüdiger Schmitz , Frederic Madesta , Maximilian Nielsen , Jenny Krause , René Werner , Thomas Rösch

Cancer diagnosis, prognosis, and therapeutic response predictions are based on morphological information from histology slides and molecular profiles from genomic data. However, most deep learning-based objective outcome prediction and…

Computer Vision and Pattern Recognition · Computer Science 2020-09-04 Richard J. Chen , Ming Y. Lu , Jingwen Wang , Drew F. K. Williamson , Scott J. Rodig , Neal I. Lindeman , Faisal Mahmood

Visual microscopic study of diseased tissue by pathologists has been the cornerstone for cancer diagnosis and prognostication for more than a century. Recently, deep learning methods have made significant advances in the analysis and…

Image and Video Processing · Electrical Eng. & Systems 2022-09-30 Puria Azadi Moghadam , Sanne Van Dalen , Karina C. Martin , Jochen Lennerz , Stephen Yip , Hossein Farahani , Ali Bashashati

Recent advances in Diffusion Probabilistic Models (DPMs) have set new standards in high-quality image synthesis. Yet, controlled generation remains challenging, particularly in sensitive areas such as medical imaging. Medical images feature…

Computer Vision and Pattern Recognition · Computer Science 2025-10-09 Sarah Cechnicka , Matthew Baugh , Weitong Zhang , Mischa Dombrowski , Zhe Li , Johannes C. Paetzold , Candice Roufosse , Bernhard Kainz

Foundation models in computational pathology promise to unlock the development of new clinical decision support systems and models for precision medicine. However, there is a mismatch between most clinical analysis, which is defined at the…

The scarcity of well-annotated medical datasets requires leveraging transfer learning from broader datasets like ImageNet or pre-trained models like CLIP. Model soups averages multiple fine-tuned models aiming to improve performance on…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Santosh Sanjeev , Nuren Zhaksylyk , Ibrahim Almakky , Anees Ur Rehman Hashmi , Mohammad Areeb Qazi , Mohammad Yaqub

Histopathology image classification is crucial for the accurate identification and diagnosis of various diseases but requires large and diverse datasets. Obtaining such datasets, however, is often costly and time-consuming due to the need…

Computer Vision and Pattern Recognition · Computer Science 2024-09-25 Leire Benito-Del-Valle , Aitor Alvarez-Gila , Itziar Eguskiza , Cristina L. Saratxaga

Histopathological image classification constitutes a pivotal task in computer-aided diagnostics. The precise identification and categorization of histopathological images are of paramount significance for early disease detection and…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Weiping Ding , Tianyi Zhou , Jiashuang Huang , Shu Jiang , Tao Hou , Chin-Teng Lin

Multimodal approaches that integrate histology and genomics hold strong potential for precision oncology. However, phenotypic and genotypic heterogeneity limits the quality of intra-modal representations and hinders effective inter-modal…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Yupei Zhang , Yating Huang , Wanming Hu , Lequan Yu , Hujun Yin , Chao Li

Multi-modal foundation models are typically trained on millions of pairs of natural images and text captions, frequently obtained through web-crawling approaches. Although such models depict excellent generative capabilities, they do not…

Computer Vision and Pattern Recognition · Computer Science 2023-01-03 Pierre Chambon , Christian Bluethgen , Curtis P. Langlotz , Akshay Chaudhari

Predicting the response of a patient to a cancer treatment is of high interest. Nonetheless, this task is still challenging from a medical point of view due to the complexity of the interaction between the patient organism and the…

Computer Vision and Pattern Recognition · Computer Science 2024-08-09 Bilel Guetarni , Feryal Windal , Halim Benhabiles , Mahfoud Chaibi , Romain Dubois , Emmanuelle Leteurtre , Dominique Collard

Esophageal cancer is one of the most common types of cancer worldwide and ranks sixth in cancer-related mortality. Accurate computer-assisted diagnosis of cancer progression can help physicians effectively customize personalized treatment…

Image and Video Processing · Electrical Eng. & Systems 2024-05-17 Chengyu Wu , Chengkai Wang , Yaqi Wang , Huiyu Zhou , Yatao Zhang , Qifeng Wang , Shuai Wang

Medical image synthesis plays a crucial role in clinical workflows, addressing the common issue of missing imaging modalities due to factors such as extended scan times, scan corruption, artifacts, patient motion, and intolerance to…

Image and Video Processing · Electrical Eng. & Systems 2025-07-23 Xiaojiao Xiao , Qinmin Vivian Hu , Guanghui Wang

Different modalities of medical images provide unique physiological and anatomical information for diseases. Multi-modal medical image fusion integrates useful information from different complementary medical images with different…

Computer Vision and Pattern Recognition · Computer Science 2025-09-12 Yushen Xu , Xiaosong Li , Yuchun Wang , Xiaoqi Cheng , Huafeng Li , Haishu Tan