English
Related papers

Related papers: A Contrastive Pre-trained Foundation Model for Dec…

200 papers

Contrastive language-image pre-training (CLIP) is a powerful vision-language model that has shown great benefits for various tasks. However, we have identified some issues with its explainability, which undermine its credibility and limit…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Yi Li , Hualiang Wang , Yiqun Duan , Jiheng Zhang , Xiaomeng Li

Existing vision-text contrastive learning like CLIP aims to match the paired image and caption embeddings while pushing others apart, which improves representation transferability and supports zero-shot prediction. However, medical…

Computer Vision and Pattern Recognition · Computer Science 2022-10-20 Zifeng Wang , Zhenbang Wu , Dinesh Agarwal , Jimeng Sun

Unsupervised deep image prior (DIP) addresses shortcomings of training data requirements and limited generalization associated with supervised deep learning. The performance of DIP depends on the network architecture and the stopping point…

Semantic noise in image classification datasets, where visually similar categories are frequently mislabeled, poses a significant challenge to conventional supervised learning approaches. In this paper, we explore the potential of using…

Computer Vision and Pattern Recognition · Computer Science 2025-09-05 Yingxuan Li , Jiafeng Mao , Yusuke Matsui

Cosine similarity is the common choice for measuring the distance between the feature representations in contrastive visual-textual alignment learning. However, empirically a learnable softmax temperature parameter is required when learning…

Computer Vision and Pattern Recognition · Computer Science 2023-10-10 Zhun Sun

Current text conditioned image generation methods output realistic looking images, but they fail to capture specific styles. Simply finetuning them on the target style datasets still struggles to grasp the style features. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Serkan Ozturk , Samet Hicsonmez , Pinar Duygulu

In low-visibility marine environments characterized by turbidity and darkness, acoustic cameras serve as visual sensors capable of generating high-resolution 2D sonar images. However, acoustic camera images are interfered with by complex…

Computer Vision and Pattern Recognition · Computer Science 2024-06-06 Xiaoteng Zhou , Katsunori Mizuno , Yilong Zhang

Deep neural networks (DNNs) have achieved remarkable success in a variety of computer vision tasks, where massive labeled images are routinely required for model optimization. Yet, the data collected from the open world are unavoidably…

Computer Vision and Pattern Recognition · Computer Science 2023-02-13 Peng Cui , Yang Yue , Zhijie Deng , Jun Zhu

Low-resolution and signal-dependent noise distribution in positron emission tomography (PET) images makes denoising process an inevitable step prior to qualitative and quantitative image analysis tasks. Conventional PET denoising methods…

Computer Vision and Pattern Recognition · Computer Science 2014-07-14 Awais Mansoor , Ulas Bagci , Daniel J. Mollura

Neural network compression empowers the effective yet unwieldy deep convolutional neural networks (CNN) to be deployed in resource-constrained scenarios. Most state-of-the-art approaches prune the model in filter-level according to the…

Computer Vision and Pattern Recognition · Computer Science 2019-06-26 Wenxiao Wang , Cong Fu , Jishun Guo , Deng Cai , Xiaofei He

We propose a deep-learning approach based on generative adversarial networks (GANs) to reduce noise in weak lensing mass maps under realistic conditions. We apply image-to-image translation using conditional GANs to the mass map obtained…

Cosmology and Nongalactic Astrophysics · Physics 2021-08-30 Masato Shirasaki , Kana Moriwaki , Taira Oogi , Naoki Yoshida , Shiro Ikeda , Takahiro Nishimichi

Removing noise from scanned pages is a vital step before their submission to the optical character recognition (OCR) system. Most available image denoising methods are supervised where the pairs of noisy/clean pages are required. However,…

Computer Vision and Pattern Recognition · Computer Science 2021-10-11 Mehrdad J Gangeh , Marcin Plata , Hamid Motahari , Nigel P Duffy

Endoscopes featuring a miniaturized design have significantly enhanced operational flexibility, portability, and diagnostic capability while substantially reducing the invasiveness of medical procedures. Recently, single-use endoscopes…

Image and Video Processing · Electrical Eng. & Systems 2025-06-19 Yu Xing , Shishi Huang , Meng Lv , Guo Chen , Huailiang Wang , Lingzhi Sui

Deconvolution of the telescope Point Spread Function (PSF) is necessary for even moderate dynamic range imaging with interferometric telescopes. The process of deconvolution can be treated as a search for a model image such that the…

Astrophysics · Physics 2009-11-10 S. Bhatnagar , T. J. Cornwell

Training deep neural networks has become a common approach for addressing image restoration problems. An alternative for training a "task-specific" network for each observation model is to use pretrained deep denoisers for imposing only the…

Image and Video Processing · Electrical Eng. & Systems 2024-04-16 Tomer Garber , Tom Tirer

Contrastive learning has emerged as a transformative method for learning effective visual representations through the alignment of image and text embeddings. However, pairwise similarity computation in contrastive loss between image and…

Computer Vision and Pattern Recognition · Computer Science 2024-04-25 Sachin Mehta , Maxwell Horton , Fartash Faghri , Mohammad Hossein Sekhavat , Mahyar Najibi , Mehrdad Farajtabar , Oncel Tuzel , Mohammad Rastegari

Deep learning methods have been considered promising for accelerating molecular screening in drug discovery and material design. Due to the limited availability of labelled data, various self-supervised molecular pre-training methods have…

Machine Learning · Computer Science 2024-07-17 Yuyan Ni , Shikun Feng , Xin Hong , Yuancheng Sun , Wei-Ying Ma , Zhi-Ming Ma , Qiwei Ye , Yanyan Lan

Crafting effective deep learning models for medical image analysis is a complex task, particularly in cases where the medical image dataset lacks significant inter-class variation. This challenge is further aggravated when employing such…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Mominul Islam , Hasib Zunair , Nabeel Mohammed

Today, Convolutional Neural Networks (CNNs) are the leading method for image denoising. They are traditionally trained on pairs of images, which are often hard to obtain for practical applications. This motivates self-supervised training…

Image and Video Processing · Electrical Eng. & Systems 2020-12-21 Alexander Krull , Tomas Vicar , Florian Jug

Mitochondria segmentation in electron microscopy images is essential in neuroscience. However, due to the image degradation during the imaging process, the large variety of mitochondrial structures, as well as the presence of noise,…

Computer Vision and Pattern Recognition · Computer Science 2021-09-28 Zhili Li , Xuejin Chen , Jie Zhao , Zhiwei Xiong