English
Related papers

Related papers: Multi-level Asymmetric Contrastive Learning for Vo…

200 papers

Self-supervised pre-training of deep learning models with contrastive learning is a widely used technique in image analysis. Current findings indicate a strong potential for contrastive pre-training on medical images. However, further…

Image and Video Processing · Electrical Eng. & Systems 2024-10-21 Daniel Wolf , Tristan Payer , Catharina Silvia Lisson , Christoph Gerhard Lisson , Meinrad Beer , Michael Götz , Timo Ropinski

Medical Vision-Language Models (MedVLMs) show immense promise in clinical applicability. However, their reliability is hindered by hallucinations, where models often fail to derive answers from visual evidence, instead relying on learned…

Computer Vision and Pattern Recognition · Computer Science 2025-12-22 Xiao Liang , Chenxi Liu , Zhi Ma , Di Wang , Bin Jing , Quan Wang , Yuanyuan Shi

The lack of large labeled medical imaging datasets, along with significant inter-individual variability compared to clinically established disease classes, poses significant challenges in exploiting medical imaging information in a…

Computer Vision and Pattern Recognition · Computer Science 2022-09-27 Matteo Ferrante , Tommaso Boccato , Simeon Spasov , Andrea Duggento , Nicola Toschi

Cross-modal medical image-report retrieval task plays a significant role in clinical diagnosis and various medical generative tasks. Eliminating heterogeneity between different modalities to enhance semantic consistency is the key challenge…

Computer Vision and Pattern Recognition · Computer Science 2025-05-21 Zeqiang Wei , Kai Jin , Xiuzhuang Zhou

Learning visual representations of medical images (e.g., X-rays) is core to medical image understanding but its progress has been held back by the scarcity of human annotations. Existing work commonly relies on fine-tuning weights…

Computer Vision and Pattern Recognition · Computer Science 2022-09-21 Yuhao Zhang , Hang Jiang , Yasuhide Miura , Christopher D. Manning , Curtis P. Langlotz

Molecular Machine Learning (ML) bears promise for efficient molecule property prediction and drug discovery. However, labeled molecule data can be expensive and time-consuming to acquire. Due to the limited labeled data, it is a great…

Machine Learning · Computer Science 2022-04-01 Yuyang Wang , Jianren Wang , Zhonglin Cao , Amir Barati Farimani

Deep learning has shown remarkable success in medical image analysis, but its reliance on large volumes of high-quality labeled data limits its applicability. While noisy labeled data are easier to obtain, directly incorporating them into…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Chengxuan Qian , Kai Han , Jianxia Ding , Chongwen Lyu , Zhenlong Yuan , Jun Chen , Zhe Liu

Multimodal representation learning is a challenging task in which previous work mostly focus on either uni-modality pre-training or cross-modality fusion. In fact, we regard modeling multimodal representation as building a skyscraper, where…

Computation and Language · Computer Science 2024-08-15 Ronghao Lin , Haifeng Hu

Traditional deep learning methods in medical imaging often focus solely on segmentation or classification, limiting their ability to leverage shared information. Multi-task learning (MTL) addresses this by combining both tasks through…

Image and Video Processing · Electrical Eng. & Systems 2024-12-03 Phuoc-Nguyen Bui , Duc-Tai Le , Junghyun Bum , Hyunseung Choo

Medical image segmentation is a fundamental and critical step in many clinical approaches. Semi-supervised learning has been widely applied to medical image segmentation tasks since it alleviates the heavy burden of acquiring…

Image and Video Processing · Electrical Eng. & Systems 2022-08-29 Yichi Zhang , Rushi Jiao , Qingcheng Liao , Dongyang Li , Jicong Zhang

The convolutional-based methods provide good segmentation performance in the medical image segmentation task. However, those methods have the following challenges when dealing with the edges of the medical images: (1) Previous…

Image and Video Processing · Electrical Eng. & Systems 2022-08-24 Jinkai Lv , Yuyong Hu , Quanshui Fu , Zhiwang Zhang , Yuqiang Hu , Lin Lv , Guoqing Yang , Jinpeng Li , Yi Zhao

Session-based recommendation aims to predict intents of anonymous users based on limited behaviors. With the ability in alleviating data sparsity, contrastive learning is prevailing in the task. However, we spot that existing contrastive…

Information Retrieval · Computer Science 2025-06-06 Xiaokun Zhang , Bo Xu , Fenglong Ma , Zhizheng Wang , Liang Yang , Hongfei Lin

With the successful application of deep learning to magnetic resonance (MR) imaging, parallel imaging techniques based on neural networks have attracted wide attention. However, in the absence of high-quality, fully sampled datasets for…

Image and Video Processing · Electrical Eng. & Systems 2022-11-15 Shanshan Wang , Ruoyou Wu , Cheng Li , Juan Zou , Ziyao Zhang , Qiegen Liu , Yan Xi , Hairong Zheng

We propose a selective learning method using meta-learning and deep reinforcement learning for medical image interpretation in the setting of limited labeling resources. Our method, MedSelect, consists of a trainable deep learning selector…

Computer Vision and Pattern Recognition · Computer Science 2021-03-29 Akshay Smit , Damir Vrabac , Yujie He , Andrew Y. Ng , Andrew L. Beam , Pranav Rajpurkar

This paper presents a novel positive and negative set selection strategy for contrastive learning of medical images based on labels that can be extracted from clinical data. In the medical field, there exists a variety of labels for data…

Computer Vision and Pattern Recognition · Computer Science 2022-11-10 Kiran Kokilepersaud , Mohit Prabhushankar , Ghassan AlRegib

In this paper, we propose a novel mutual consistency network (MC-Net+) to effectively exploit the unlabeled data for semi-supervised medical image segmentation. The MC-Net+ model is motivated by the observation that deep models trained with…

Computer Vision and Pattern Recognition · Computer Science 2022-07-05 Yicheng Wu , Zongyuan Ge , Donghao Zhang , Minfeng Xu , Lei Zhang , Yong Xia , Jianfei Cai

The image-text retrieval task aims to retrieve relevant information from a given image or text. The main challenge is to unify multimodal representation and distinguish fine-grained differences across modalities, thereby finding similar…

Multimedia · Computer Science 2024-05-20 Ziyu Gong , Chengcheng Mai , Yihua Huang

Dense prediction tasks such as segmentation and detection of pathological entities hold crucial clinical value in computational pathology workflows. However, obtaining dense annotations on large cohorts is usually tedious and expensive.…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Jingwei Zhang , Saarthak Kapse , Ke Ma , Prateek Prasanna , Maria Vakalopoulou , Joel Saltz , Dimitris Samaras

Many contrastive representation learning methods learn a single global representation of an entire image. However, dense contrastive representation learning methods such as DenseCL (Wang et al., 2021) can learn better representations for…

Computer Vision and Pattern Recognition · Computer Science 2023-01-12 Berk Iskender , Zhenlin Xu , Simon Kornblith , En-Hung Chu , Maryam Khademi

Semi-supervised learning is of great significance in medical image segmentation by exploiting unlabeled data. Among its strategies, the co-training framework is prominent. However, previous co-training studies predominantly concentrate on…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Pengcheng Zhou , Lantian Zhang , Wei Li