English
Related papers

Related papers: ModalTune: Fine-Tuning Slide-Level Foundation Mode…

200 papers

Foundation models have emerged as a powerful paradigm in computational pathology (CPath), enabling scalable and generalizable analysis of histopathological images. While early developments centered on uni-modal models trained solely on…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Dong Li , Guihong Wan , Xintao Wu , Xinyu Wu , Xiaohui Chen , Yi He , Christine G. Lian , Peter K. Sorger , Yevgeniy R. Semenov , Chen Zhao

The performance of deep learning models is known to scale with data quantity and diversity. In pathology, as in many other medical imaging domains, the availability of labeled images for a specific task is often limited. Self-supervised…

Computer Vision and Pattern Recognition · Computer Science 2026-02-05 Jonas Ammeling , Jonathan Ganz , Emely Rosbach , Ludwig Lausser , Christof A. Bertram , Katharina Breininger , Marc Aubreville

The advancement of artificial intelligence (AI) for organ segmentation and tumor detection is propelled by the growing availability of computed tomography (CT) datasets with detailed, per-voxel annotations. However, these AI models often…

Image and Video Processing · Electrical Eng. & Systems 2024-05-29 Jie Liu , Yixiao Zhang , Kang Wang , Mehmet Can Yavuz , Xiaoxi Chen , Yixuan Yuan , Haoliang Li , Yang Yang , Alan Yuille , Yucheng Tang , Zongwei Zhou

Ovarian cancer is one of the most harmful gynecological diseases. Detecting ovarian tumors in early stage with computer-aided techniques can efficiently decrease the mortality rate. With the improvement of medical treatment standard,…

Computer Vision and Pattern Recognition · Computer Science 2023-12-01 Qi Zhao , Shuchang Lyu , Wenpei Bai , Linghan Cai , Binghao Liu , Guangliang Cheng , Meijing Wu , Xiubo Sang , Min Yang , Lijiang Chen

Molecular testing of tumor samples for targetable biomarkers is restricted by a lack of standardization, turnaround-time, cost, and tissue availability across cancer types. Additionally, targetable alterations of low prevalence may not be…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Kshitij Ingale , Sun Hae Hong , Qiyuan Hu , Renyu Zhang , Bo Osinski , Mina Khoshdeli , Josh Och , Kunal Nagpal , Martin C. Stumpe , Rohan P. Joshi

Supervised deep learning methods have achieved considerable success in medical image analysis, owing to the availability of large-scale and well-annotated datasets. However, creating such datasets for whole slide images (WSIs) in…

Computer Vision and Pattern Recognition · Computer Science 2024-06-10 Hao Wang , Euijoon Ahn , Jinman Kim

The rapid development of diagnostic technologies in healthcare is leading to higher requirements for physicians to handle and integrate the heterogeneous, yet complementary data that are produced during routine practice. For instance, the…

Machine Learning · Computer Science 2023-01-30 Can Cui , Haichun Yang , Yaohong Wang , Shilin Zhao , Zuhayr Asad , Lori A. Coburn , Keith T. Wilson , Bennett A. Landman , Yuankai Huo

Ensuring robust safety alignment while preserving utility is critical for the reliable deployment of Large Language Models (LLMs). However, current techniques fundamentally suffer from intertwined deficiencies: insufficient robustness…

Machine Learning · Computer Science 2025-08-14 Birong Pan , Mayi Xu , Qiankun Pi , Jianhao Chen , Yuanyuan Zhu , Ming Zhong , Tieyun Qian

Semi-supervised learning addresses the issue of limited annotations in medical images effectively, but its performance is often inadequate for complex backgrounds and challenging tasks. Multi-modal fusion methods can significantly improve…

Computer Vision and Pattern Recognition · Computer Science 2025-06-23 Dongdong Meng , Sheng Li , Hao Wu , Guoping Wang , Xueqing Yan

This project aims to break down large pathology images into small tiles and then cluster those tiles into distinct groups without the knowledge of true labels, our analysis shows how difficult certain aspects of clustering tumorous and…

Image and Video Processing · Electrical Eng. & Systems 2020-12-29 Mostafa Ibrahim , Kevin Bryson

Whole Slide Images (WSI), obtained by high-resolution digital scanning of microscope slides at multiple scales, are the cornerstone of modern Digital Pathology. However, they represent a particular challenge to AI-based/AI-mediated analysis…

Computer Vision and Pattern Recognition · Computer Science 2024-04-12 Martim Afonso , Praphulla M. S. Bhawsar , Monjoy Saha , Jonas S. Almeida , Arlindo L. Oliveira

Open-source, multilingual medical large language models (LLMs) have the potential to serve linguistically diverse populations across different regions. Adapting generic LLMs for healthcare often requires continual pretraining, but this…

Computation and Language · Computer Science 2024-09-10 Meng Zhou , Surajsinh Parmar , Anubhav Bhatti

Self-supervised learning approaches leverage unlabeled samples to acquire generic knowledge about different concepts, hence allowing for annotation-efficient downstream task learning. In this paper, we propose a novel self-supervised method…

Computer Vision and Pattern Recognition · Computer Science 2020-10-27 Aiham Taleb , Christoph Lippert , Tassilo Klein , Moin Nabi

Semi-supervised learning (SSL) has become a promising solution to alleviate the annotation burden of deep learning-based medical image segmentation models. While recent advances in foundation model-driven SSL have pushed the boundary to…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Yichi Zhang , Le Xue , Bichun Xu , Judong Luo , Zhigang Wu , Yu Fu , Zixin Hu , Yuan Cheng , Yuan Qi

The visual models pretrained on large-scale benchmarks encode general knowledge and prove effective in building more powerful representations for downstream tasks. Most existing approaches follow the fine-tuning paradigm, either by…

Computer Vision and Pattern Recognition · Computer Science 2023-08-24 Nan Zhou , Jiaxin Chen , Di Huang

In the diverse field of medical imaging, automatic segmentation has numerous applications and must handle a wide variety of input domains, such as different types of Computed Tomography (CT) scans and Magnetic Resonance (MR) images. This…

Image and Video Processing · Electrical Eng. & Systems 2024-11-26 Chengyin Li , Hui Zhu , Rafi Ibn Sultan , Hassan Bagher Ebadian , Prashant Khanduri , Chetty Indrin , Kundan Thind , Dongxiao Zhu

An important objective in computational biology is the efficient integration of multi-omics data. The task of integration comes with challenges: multi-omics data are most often unpaired (requiring diagonal integration), partially labeled…

Machine Learning · Computer Science 2025-09-16 Daniel Lepe-Soltero , Thierry Artières , Anaïs Baudot , Paul Villoutreix

In the molecular domain, numerous studies have explored the use of multimodal large language models (LLMs) to construct a general-purpose, multi-task molecular model. However, these efforts are still far from achieving a truly universal…

Machine Learning · Computer Science 2025-10-31 Chengxin Hu , Hao Li , Yihe Yuan , Zezheng Song , Chenyang Zhao , Haixin Wang

Annotation cost is a bottleneck for collecting massive data in mammography, especially for training deep neural networks. In this paper, we study the use of heterogeneous levels of annotation granularity to improve predictive performances.…

Image and Video Processing · Electrical Eng. & Systems 2019-09-13 Thi-Lam-Thuy Le , Nicolas Thome , Sylvain Bernard , Vincent Bismuth , Fanny Patoureaux

Recently, decomposing complex problems into simple subtasks--a crucial part of human-like natural planning--to solve the given problem has significantly boosted the performance of large language models (LLMs). However, leveraging such…

Computation and Language · Computer Science 2025-07-11 Mihir Parmar , Palash Goyal , Xin Liu , Yiwen Song , Mingyang Ling , Chitta Baral , Hamid Palangi , Tomas Pfister