English
Related papers

Related papers: MuellerPT: Decomposition Driven Pretraining for De…

200 papers

Limited labeled data makes it hard to train models from scratch in medical domain, and an important paradigm is pre-training and then fine-tuning. Large pre-trained models contain rich representations, which can be adapted to downstream…

Computer Vision and Pattern Recognition · Computer Science 2023-07-20 Along He , Kai Wang , Zhihong Wang , Tao Li , Huazhu Fu

Deep image prior (DIP) has been successfully applied to positron emission tomography (PET) image restoration, enabling represent implicit prior using only convolutional neural network architecture without training dataset, whereas the…

Medical Physics · Physics 2024-04-23 Yuya Onishi , Fumio Hashimoto , Kibo Ote , Keisuke Matsubara , Masanobu Ibaraki

Dual-energy computed tomography (DECT) enables material-specific imaging through acquisitions at two different X-ray energy spectra. Material decomposition from DECT data is an ill-posed inverse problem that is highly sensitive to noise…

Medical image segmentation is a fundamental yet challenging task due to the arduous process of acquiring large volumes of high-quality labeled data from experts. Contrastive learning offers a promising but still problematic solution to this…

Computer Vision and Pattern Recognition · Computer Science 2025-02-14 Shuang Zeng , Lei Zhu , Xinliang Zhang , Micky C Nnamdi , Wenqi Shi , J Ben Tamo , Qian Chen , Hangzhou He , Lujia Jin , Zifeng Tian , Qiushi Ren , Zhaoheng Xie , Yanye Lu

In this paper, we introduce a new vision-language pre-trained model -- ImageBERT -- for image-text joint embedding. Our model is a Transformer-based model, which takes different modalities as input and models the relationship between them.…

Computer Vision and Pattern Recognition · Computer Science 2020-01-24 Di Qi , Lin Su , Jia Song , Edward Cui , Taroon Bharti , Arun Sacheti

Deep Learning (DL) requires a large amount of training data to provide quality outcomes. However, the field of medical imaging suffers from the lack of sufficient data for properly training DL models because medical images require manual…

Computer Vision and Pattern Recognition · Computer Science 2021-10-14 Laith Alzubaidi , J. Santamaría , Mohamed Manoufali , Beadaa Mohammed , Mohammed A. Fadhel , Jinglan Zhang , Ali H. Al-Timemy , Omran Al-Shamma , Ye Duan

The Mueller Matrix Polar Decomposition method decomposes a Mueller matrix into a diattenuator, a retarder, and a depolarizer. Among these elements, the retarder, which plays a key role in medical and material characterization, is modelled…

This study introduces a Masked Degradation Classification Pre-Training method (MaskDCPT), designed to facilitate the classification of degradation types in input images, leading to comprehensive image restoration pre-training. Unlike…

Computer Vision and Pattern Recognition · Computer Science 2025-10-16 JiaKui Hu , Zhengjian Yao , Lujia Jin , Yinghao Chen , Yanye Lu

Dense prediction tasks such as segmentation and detection of pathological entities hold crucial clinical value in computational pathology workflows. However, obtaining dense annotations on large cohorts is usually tedious and expensive.…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Jingwei Zhang , Saarthak Kapse , Ke Ma , Prateek Prasanna , Maria Vakalopoulou , Joel Saltz , Dimitris Samaras

Deep learning methods have demonstrated promising results in predicting BI-RADS scores from mammography images. However, the interpretation of these images can vary, leading to discrepancies even among radiologists. Given the inherent…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Halil Ibrahim Gulluk , Olivier Gevaert

The success of deep learning methods in medical image segmentation tasks heavily depends on a large amount of labeled data to supervise the training. On the other hand, the annotation of biomedical images requires domain knowledge and can…

Computer Vision and Pattern Recognition · Computer Science 2021-09-30 Xinrong Hu , Dewen Zeng , Xiaowei Xu , Yiyu Shi

Self-supervised learning has proven to be an effective way to learn representations in domains where annotated labels are scarce, such as medical imaging. A widely adopted framework for this purpose is contrastive learning and it has been…

Computer Vision and Pattern Recognition · Computer Science 2024-02-23 Hugo Figueiras , Helena Aidos , Nuno Cruz Garcia

Few-shot medical image semantic segmentation is of paramount importance in the domain of medical image analysis. However, existing methodologies grapple with the challenge of data scarcity during the training phase, leading to over-fitting.…

Computer Vision and Pattern Recognition · Computer Science 2023-07-20 Zhaoxin Fan , Puquan Pan , Zeren Zhang , Ce Chen , Tianyang Wang , Siyang Zheng , Min Xu

Probabilistic atlas priors have been commonly used to derive adaptive and robust brain MRI segmentation algorithms. Widely-used neuroimage analysis pipelines rely heavily on these techniques, which are often computationally expensive. In…

Computer Vision and Pattern Recognition · Computer Science 2019-07-24 Adrian V. Dalca , Evan Yu , Polina Golland , Bruce Fischl , Mert R. Sabuncu , Juan Eugenio Iglesias

Self-supervised pre-training of deep learning models with contrastive learning is a widely used technique in image analysis. Current findings indicate a strong potential for contrastive pre-training on medical images. However, further…

Image and Video Processing · Electrical Eng. & Systems 2024-10-21 Daniel Wolf , Tristan Payer , Catharina Silvia Lisson , Christoph Gerhard Lisson , Meinrad Beer , Michael Götz , Timo Ropinski

Conventional continual pretraining (CPT) for large language model (LLM) domain adaptation often suffers from catastrophic forgetting and limited domain capacity. Existing strategies adopt layer expansion, introducing additional trainable…

Machine Learning · Computer Science 2025-10-14 Jinyang Zhang , Yue Fang , Hongxin Ding , Weibin Liao , Muyang Ye , Xu Chu , Junfeng Zhao , Yasha Wang

Pre-trained encoders are widely employed in dense prediction tasks for their capability to effectively extract visual features from images. The decoder subsequently processes these features to generate pixel-level predictions. However, due…

Machine Learning · Computer Science 2025-03-18 Chao Ning , Wanshui Gan , Weihao Xuan , Naoto Yokoya

Information retrieval (IR) is essential in biomedical knowledge acquisition and clinical decision support. While recent progress has shown that language model encoders perform better semantic retrieval, training such models requires…

Information Retrieval · Computer Science 2024-01-17 Qiao Jin , Won Kim , Qingyu Chen , Donald C. Comeau , Lana Yeganova , W. John Wilbur , Zhiyong Lu

The success of deep learning heavily depends on the availability of large labeled training sets. However, it is hard to get large labeled datasets in medical image domain because of the strict privacy concern and costly labeling efforts.…

Computer Vision and Pattern Recognition · Computer Science 2021-09-30 Dewen Zeng , Yawen Wu , Xinrong Hu , Xiaowei Xu , Haiyun Yuan , Meiping Huang , Jian Zhuang , Jingtong Hu , Yiyu Shi

The accurate segmentation of lesions in whole-body PET/CT imaging is es-sential for tumor characterization, treatment planning, and response assess-ment, yet current manual workflows are labor-intensive and prone to inter-observer…

Image and Video Processing · Electrical Eng. & Systems 2025-09-04 Moona Mazher , Steven A Niederer , Abdul Qayyum