English
Related papers

Related papers: PLUTO-4: Frontier Pathology Foundation Models

200 papers

Due to the increasing workload of pathologists, the need for automation to support diagnostic tasks and quantitative biomarker evaluation is becoming more and more apparent. Foundation models have the potential to improve generalizability…

Image and Video Processing · Electrical Eng. & Systems 2025-01-13 Till Nicke , Jan Raphael Schaefer , Henning Hoefener , Friedrich Feuerhake , Dorit Merhof , Fabian Kiessling , Johannes Lotz

Wearable medical sensors (WMSs) are revolutionizing smart healthcare by enabling continuous, real-time monitoring of user physiological signals, especially in the field of consumer healthcare. The integration of WMSs and modern machine…

Machine Learning · Computer Science 2024-10-22 Chia-Hao Li , Niraj K. Jha

Foundation models (FMs) have shown great promise in medical image analysis by improving generalization across diverse downstream tasks. In ophthalmology, several FMs have recently emerged, but there is still no clear answer to fundamental…

Accurate classification of skin lesions from dermatoscopic images is essential for diagnosis and treatment of skin cancer. In this study, we investigate the utility of a dermatology-specific foundation model, PanDerm, in comparison with two…

Computer Vision and Pattern Recognition · Computer Science 2025-05-23 Amirreza Mahbod , Rupert Ecker , Ramona Woitek

Vision Foundation Models (VFMs) have demonstrated impressive representational capabilities. However, adapting them to downstream tasks via full fine-tuning incurs prohibitive computational and storage overhead. Parameter-Efficient…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Lingyu Xiong , Jinjin Shi , Xuran Xu , Cong Luo , Runyu Shi , Ying Huang

Quantifying the phagocytosis of dynamic, unstained cells is essential for evaluating neurodegenerative diseases. However, measuring rapid cell interactions and distinguishing cells from background make this task very challenging when…

Image and Video Processing · Electrical Eng. & Systems 2024-03-14 Mehdi Ounissi , Morwena Latouche , Daniel Racoceanu

With the advent of large pre-trained transformer models, fine-tuning these models for various downstream tasks is a critical problem. Paucity of training data, the existence of data silos, and stringent privacy constraints exacerbate this…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 Naif Alkhunaizi , Faris Almalik , Rouqaiah Al-Refai , Muzammal Naseer , Karthik Nandakumar

We explore a new class of diffusion models based on the transformer architecture. We train latent diffusion models of images, replacing the commonly-used U-Net backbone with a transformer that operates on latent patches. We analyze the…

Computer Vision and Pattern Recognition · Computer Science 2023-03-03 William Peebles , Saining Xie

Objective: To comparatively evaluate several transformer model architectures at identifying protected health information (PHI) in the i2b2/UTHealth 2014 clinical text de-identification challenge corpus. Methods: The i2b2/UTHealth 2014…

Computation and Language · Computer Science 2022-04-15 Christopher Meaney , Wali Hakimpour , Sumeet Kalia , Rahim Moineddin

Foundation models have demonstrated remarkable success across diverse domains and tasks, primarily due to the thrive of large-scale, diverse, and high-quality datasets. However, in the field of medical imaging, the curation and assembling…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Zhongying Deng , Cheng Tang , Ziyan Huang , Jiashi Lin , Ying Chen , Junzhi Ning , Chenglong Ma , Jiyao Liu , Wei Li , Yinghao Zhu , Shujian Gao , Yanyan Huang , Sibo Ju , Yanzhou Su , Pengcheng Chen , Wenhao Tang , Tianbin Li , Haoyu Wang , Yuanfeng Ji , Hui Sun , Shaobo Min , Liang Peng , Feilong Tang , Haochen Xue , Rulin Zhou , Chaoyang Zhang , Wenjie Li , Shaohao Rui , Weijie Ma , Xingyue Zhao , Yibin Wang , Kun Yuan , Zhaohui Lu , Shujun Wang , Jinjie Wei , Lihao Liu , Dingkang Yang , Lin Wang , Yulong Li , Haolin Yang , Yiqing Shen , Lequan Yu , Xiaowei Hu , Yun Gu , Yicheng Wu , Benyou Wang , Minghui Zhang , Angelica I. Aviles-Rivero , Qi Gao , Hongming Shan , Xiaoyu Ren , Fang Yan , Hongyu Zhou , Haodong Duan , Maosong Cao , Shanshan Wang , Bin Fu , Xiaomeng Li , Zhi Hou , Chunfeng Song , Lei Bai , Yuan Cheng , Yuandong Pu , Xiang Li , Wenhai Wang , Hao Chen , Jiaxin Zhuang , Songyang Zhang , Huiguang He , Mengzhang Li , Bohan Zhuang , Zhian Bai , Rongshan Yu , Liansheng Wang , Yukun Zhou , Xiaosong Wang , Xin Guo , Guanbin Li , Xiangru Lin , Dakai Jin , Mianxin Liu , Wenlong Zhang , Qi Qin , Conghui He , Yuqiang Li , Ye Luo , Nanqing Dong , Jie Xu , Wenqi Shao , Bo Zhang , Qiujuan Yan , Yihao Liu , Jun Ma , Zhi Lu , Yuewen Cao , Zongwei Zhou , Jianming Liang , Shixiang Tang , Qi Duan , Dongzhan Zhou , Chen Jiang , Yuyin Zhou , Yanwu Xu , Jiancheng Yang , Shaoting Zhang , Xiaohong Liu , Siqi Luo , Yi Xin , Chaoyu Liu , Haochen Wen , Xin Chen , Alejandro Lozano , Min Woo Sun , Yuhui Zhang , Yue Yao , Xiaoxiao Sun , Serena Yeung-Levy , Xia Li , Jing Ke , Chunhui Zhang , Zongyuan Ge , Ming Hu , Jin Ye , Zhifeng Li , Yirong Chen , Yu Qiao , Junjun He

Face Anti-Spoofing (FAS) remains challenging due to the requirement for robust domain generalization across unseen environments. While recent trends leverage Vision-Language Models (VLMs) for semantic supervision, these multimodal…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Mika Feng , Pierre Gallin-Martel , Koichi Ito , Takafumi Aoki

Objective: To enhance automated de-identification of radiology reports by scaling transformer-based models through extensive training datasets and benchmarking performance against commercial cloud vendor systems for protected health…

Computation and Language · Computer Science 2025-11-24 Eva Prakash , Maayane Attias , Pierre Chambon , Justin Xu , Steven Truong , Jean-Benoit Delbrouck , Tessa Cook , Curtis Langlotz

Point-based cell detection (PCD), which pursues high-performance cell sensing under low-cost data annotation, has garnered increased attention in computational pathology community. Unlike mainstream PCD methods that rely on intermediate…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Zhongyi Shui , Sunyi Zheng , Chenglu Zhu , Shichuan Zhang , Xiaoxuan Yu , Honglin Li , Jingxiong Li , Pingyi Chen , Lin Yang

Computational pathology holds substantial promise for improving diagnosis and guiding treatment decisions. Recent pathology foundation models enable the extraction of rich patch-level representations from large-scale whole-slide images…

Computer Vision and Pattern Recognition · Computer Science 2025-11-20 Xiangde Luo , Jinxi Xiang , Yuanfeng Ji , Ruijiang Li

Cytology is essential for cancer diagnostics and screening due to its minimally invasive nature. However, the development of robust deep learning models for digital cytology is challenging due to the heterogeneity in staining and…

Computer Vision and Pattern Recognition · Computer Science 2025-04-21 Vedrana Ivezić , Ashwath Radhachandran , Ekaterina Redekop , Shreeram Athreya , Dongwoo Lee , Vivek Sant , Corey Arnold , William Speier

Significant advancements in AI-driven multimodal medical image diagnosis have led to substantial improvements in ophthalmic disease identification in recent years. However, acquiring paired multimodal ophthalmic images remains prohibitively…

Computer Vision and Pattern Recognition · Computer Science 2025-09-11 Zhihao Zhao , Yinzheng Zhao , Junjie Yang , Xiangtong Yao , Quanmin Liang , Daniel Zapp , Kai Huang , Nassir Navab , M. Ali Nasseri

Lupus nephritis (LN) is a severe complication of systemic lupus erythematosus that affects pediatric patients with significantly greater severity and worse renal outcomes compared to adults. Despite the urgent clinical need, predicting…

Image and Video Processing · Electrical Eng. & Systems 2026-03-09 Yuewen Huang , Zhitao Ye , Guangnan Feng , Fudan Zheng , Xia Gao , Yutong Lu

Musculoskeletal disorders represent a significant global health burden and are a leading cause of disability worldwide. While MRI is essential for accurate diagnosis, its interpretation remains exceptionally challenging. Radiologists must…

Computer Vision and Pattern Recognition · Computer Science 2026-02-25 Tian Lan , Lei Xu , Zimu Yuan , Shanggui Liu , Jiajun Liu , Jiaxin Liu , Weilai Xiang , Hongyu Yang , Dong Jiang , Jianxin Yin , Dingyu Wang

Parameter-efficient fine-tuning (PEFT) that was initially developed for exploiting pre-trained large language models has recently emerged as an effective approach to perform transfer learning on computer vision tasks. However, the…

Computer Vision and Pattern Recognition · Computer Science 2024-01-23 Chenyu Lian , Hong-Yu Zhou , Yizhou Yu , Liansheng Wang

In hematology, computational models offer significant potential to improve diagnostic accuracy, streamline workflows, and reduce the tedious work of analyzing single cells in peripheral blood or bone marrow smears. However, clinical…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Valentin Koch , Sophia J. Wagner , Salome Kazeminia , Ece Sancar , Matthias Hehr , Julia Schnabel , Tingying Peng , Carsten Marr