English
Related papers

Related papers: Self-Supervised Pre-Training with Contrastive and …

200 papers

In the past few years, deep learning-based methods have demonstrated enormous success for solving inverse problems in medical imaging. In this work, we address the following question:\textit{Given a set of measurements obtained from real…

Image and Video Processing · Electrical Eng. & Systems 2019-05-24 Ortal Senouf , Sanketh Vedula , Tomer Weiss , Alex Bronstein , Oleg Michailovich , Michael Zibulevsky

Predicting whether a treatment leads to meaningful improvement is a central challenge in personalized medicine, particularly when disease progression manifests as subtle visual changes over time. While data-driven deep learning (DL) offers…

Image and Video Processing · Electrical Eng. & Systems 2025-11-21 Jana Armouti , Nikhil Madaan , Rohan Panda , Tom Fox , Laura Hutchins , Amita Krishnan , Ricardo Rodriguez , Bennett DeBoisblanc , Deva Ramanan , John Galeotti , Gautam Gare

Linking sheet music images to audio recordings remains a key problem for the development of efficient cross-modal music retrieval systems. One of the fundamental approaches toward this task is to learn a cross-modal embedding space via deep…

Sound · Computer Science 2023-09-22 Luis Carvalho , Tobias Washüttl , Gerhard Widmer

Learning discriminative representations of unlabelled data is a challenging task. Contrastive self-supervised learning provides a framework to learn meaningful representations using learned notions of similarity measures from simple pretext…

Computer Vision and Pattern Recognition · Computer Science 2023-01-04 Nicklas Boserup , Raghavendra Selvan

Self-supervised pretraining has been shown to yield powerful representations for transfer learning. These performance gains come at a large computational cost however, with state-of-the-art methods requiring an order of magnitude more…

Computer Vision and Pattern Recognition · Computer Science 2021-08-06 Olivier J. Hénaff , Skanda Koppula , Jean-Baptiste Alayrac , Aaron van den Oord , Oriol Vinyals , João Carreira

Medical image segmentation is a crucial task in medical image analysis, but it can be very challenging especially when there are less labeled data but with large unlabeled data. Contrastive learning has proven to be effective for medical…

Computer Vision and Pattern Recognition · Computer Science 2025-02-11 Shihuan He , Zhihui Lai , Ruxin Wang , Heng Kong

Self supervision and natural language supervision have emerged as two exciting ways to train general purpose image encoders which excel at a variety of downstream tasks. Recent works such as M3AE and SLIP have suggested that these…

Computer Vision and Pattern Recognition · Computer Science 2023-05-16 Floris Weers , Vaishaal Shankar , Angelos Katharopoulos , Yinfei Yang , Tom Gunter

Supervised deep learning usually faces more challenges in medical images than in natural images. Since annotations in medical images require the expertise of doctors and are more time-consuming and expensive. Thus, some researchers turn to…

Computer Vision and Pattern Recognition · Computer Science 2025-02-25 Tao Yang , Lisheng Wang

This paper considers self-supervised cross-modal coordination as a strategy enabling utilization of multiple modalities and large volumes of unlabeled plankton data to build models for plankton recognition. Automated imaging instruments…

Computer Vision and Pattern Recognition · Computer Science 2026-04-20 Joona Kareinen , Veikka Immonen , Tuomas Eerola , Lumi Haraguchi , Lasse Lensu , Kaisa Kraft , Sanna Suikkanen , Heikki Kälviäinen

Self-supervised learning approaches leverage unlabeled samples to acquire generic knowledge about different concepts, hence allowing for annotation-efficient downstream task learning. In this paper, we propose a novel self-supervised method…

Computer Vision and Pattern Recognition · Computer Science 2020-10-27 Aiham Taleb , Christoph Lippert , Tassilo Klein , Moin Nabi

Self-supervised learning is a machine learning approach that generates implicit labels by learning underlined patterns and extracting discriminative features from unlabeled data without manual labelling. Contrastive learning introduces the…

Computer Vision and Pattern Recognition · Computer Science 2025-10-13 Asifullah Khan , Laiba Asmatullah , Anza Malik , Shahzaib Khan , Hamna Asif

The medical imaging literature has witnessed remarkable progress in high-performing segmentation models based on convolutional neural networks. Despite the new performance highs, the recent advanced segmentation models still require large,…

Image and Video Processing · Electrical Eng. & Systems 2020-02-13 Nima Tajbakhsh , Laura Jeyaseelan , Qian Li , Jeffrey Chiang , Zhihao Wu , Xiaowei Ding

Contrastive self-supervised learning methods famously produce high quality transferable representations by learning invariances to different data augmentations. Invariances established during pre-training can be interpreted as strong…

Computer Vision and Pattern Recognition · Computer Science 2023-04-05 Ruchika Chavhan , Henry Gouk , Jan Stuehmer , Calum Heggan , Mehrdad Yaghoobi , Timothy Hospedales

Medical image analysis using supervised deep learning methods remains problematic because of the reliance of deep learning methods on large amounts of labelled training data. Although medical imaging data repositories continue to expand…

Computer Vision and Pattern Recognition · Computer Science 2019-06-11 Euijoon Ahn , Ashnil Kumar , Dagan Feng , Michael Fulham , Jinman Kim

Scribble-supervised medical image segmentation tackles the limitation of sparse masks. Conventional approaches alternate between: labeling pseudo-masks and optimizing network parameters. However, such iterative two-stage paradigm is…

Computer Vision and Pattern Recognition · Computer Science 2023-10-02 Zefan Yang , Di Lin , Dong Ni , Yi Wang

We explore the value of weak labels in learning transferable representations for medical images. Compared to hand-labeled datasets, weak or inexact labels can be acquired in large quantities at significantly lower cost and can provide…

Computer Vision and Pattern Recognition · Computer Science 2021-08-05 Boon Peng Yap , Beng Koon Ng

Semi-supervised learning has demonstrated great potential in medical image segmentation by utilizing knowledge from unlabeled data. However, most existing approaches do not explicitly capture high-level semantic relations between distant…

Computer Vision and Pattern Recognition · Computer Science 2023-12-07 Qianying Liu , Xiao Gu , Paul Henderson , Fani Deligianni

The growth of global consumption has motivated important applications of deep learning to smart manufacturing and machine health monitoring. In particular, analyzing vibration data offers great potential to extract meaningful insights into…

Machine Learning · Computer Science 2024-05-30 Anthony Zhou , Amir Barati Farimani

Self-supervised learning, which is strikingly referred to as the dark matter of intelligence, is gaining more attention in biomedical applications of deep learning. In this work, we introduce a novel self-supervision objective for the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Royden Wagner , Carlos Fernandez Lopez , Christoph Stiller

1. Research question: With the growing interest in skin diseases and skin aesthetics, the ability to predict facial wrinkles is becoming increasingly important. This study aims to evaluate whether a computational model, convolutional neural…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Ik Jun Moon , Junho Moon , Ikbeom Jang