English
Related papers

Related papers: Forward-Forward Contrastive Learning

200 papers

Self-supervised pre-training of deep learning models with contrastive learning is a widely used technique in image analysis. Current findings indicate a strong potential for contrastive pre-training on medical images. However, further…

Image and Video Processing · Electrical Eng. & Systems 2024-10-21 Daniel Wolf , Tristan Payer , Catharina Silvia Lisson , Christoph Gerhard Lisson , Meinrad Beer , Michael Götz , Timo Ropinski

Analysis of cardiac ultrasound images is commonly performed in routine clinical practice for quantification of cardiac function. Its increasing automation frequently employs deep learning networks that are trained to predict disease or…

Computer Vision and Pattern Recognition · Computer Science 2021-08-09 Agisilaos Chartsias , Shan Gao , Angela Mumith , Jorge Oliveira , Kanwal Bhatia , Bernhard Kainz , Arian Beqiri

Contrastive pretraining is well-known to improve downstream task performance and model generalisation, especially in limited label settings. However, it is sensitive to the choice of augmentation pipeline. Positive pairs should preserve…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Melanie Roschewitz , Fabio De Sousa Ribeiro , Tian Xia , Galvin Khara , Ben Glocker

In this work, we present Multi-Level Contrastive Learning for Dense Prediction Task (MCL), an efficient self-supervised method for learning region-level feature representation for dense prediction tasks. Our method is motivated by the three…

Computer Vision and Pattern Recognition · Computer Science 2023-04-05 Qiushan Guo , Yizhou Yu , Yi Jiang , Jiannan Wu , Zehuan Yuan , Ping Luo

A label-efficient paradigm in computer vision is based on self-supervised contrastive pre-training on unlabeled data followed by fine-tuning with a small number of labels. Making practical use of a federated computing environment in the…

Machine Learning · Computer Science 2021-09-17 Nanqing Dong , Irina Voiculescu

The Forward-Forward Learning (FFL) algorithm is a recently proposed solution for training neural networks without needing memory-intensive backpropagation. During training, labels accompany input data, classifying them as positive or…

Machine Learning · Computer Science 2024-05-22 Ali Karkehabadi , Houman Homayoun , Avesta Sasan

The accurate diagnosis of pathological subtypes of lung cancer is of paramount importance for follow-up treatments and prognosis managements. Assessment methods utilizing deep learning technologies have introduced novel approaches for…

Image and Video Processing · Electrical Eng. & Systems 2024-07-19 Yuan Jin , Gege Ma , Geng Chen , Tianling Lyu , Jan Egger , Junhui Lyu , Shaoting Zhang , Wentao Zhu

Vision-Language Pre-Trained models, notably CLIP, that utilize contrastive learning have proven highly adept at extracting generalizable visual features. To inherit the well-learned knowledge of VLP models for downstream tasks, several…

Computer Vision and Pattern Recognition · Computer Science 2026-01-29 Yi Zhang , Weicheng Lin , Liang-Jie Zhang

Representation learning offers a conduit to elucidate distinctive features within the latent space and interpret the deep models. However, the randomness of lesion distribution and the complexity of low-quality factors in medical images…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Qingshan Hou , Shuai Cheng , Peng Cao , Jinzhu Yang , Xiaoli Liu , Osmar R. Zaiane , Yih Chung Tham

Supervised deep learning needs a large amount of labeled data to achieve high performance. However, in medical imaging analysis, each site may only have a limited amount of data and labels, which makes learning ineffective. Federated…

Image and Video Processing · Electrical Eng. & Systems 2022-08-09 Yawen Wu , Dewen Zeng , Zhepeng Wang , Yiyu Shi , Jingtong Hu

Generally, current image manipulation detection models are simply built on manipulation traces. However, we argue that those models achieve sub-optimal detection performance as it tends to: 1) distinguish the manipulation traces from a lot…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Wenyan Pan , Zhili Zhou , Guangcan Liu , Teng Huang , Hongyang Yan , Q. M. Jonathan Wu

Contrastive learning (CL) can learn generalizable feature representations and achieve the state-of-the-art performance of downstream tasks by finetuning a linear classifier on top of it. However, as adversarial robustness becomes vital in…

Computer Vision and Pattern Recognition · Computer Science 2021-11-02 Lijie Fan , Sijia Liu , Pin-Yu Chen , Gaoyuan Zhang , Chuang Gan

Complete removal of cancer tumors with a negative specimen margin during lumpectomy is essential in reducing breast cancer recurrence. However, 2D specimen radiography (SR), the current method used to assess intraoperative specimen margin…

Computer Vision and Pattern Recognition · Computer Science 2025-06-27 Tyler Ward , Xiaoqin Wang , Braxton McFarland , Md Atik Ahamed , Sahar Nozad , Talal Arshad , Hafsa Nebbache , Jin Chen , Abdullah Imran

Dense prediction tasks such as segmentation and detection of pathological entities hold crucial clinical value in computational pathology workflows. However, obtaining dense annotations on large cohorts is usually tedious and expensive.…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Jingwei Zhang , Saarthak Kapse , Ke Ma , Prateek Prasanna , Maria Vakalopoulou , Joel Saltz , Dimitris Samaras

Image forgery detection aims to detect and locate forged regions in an image. Most existing forgery detection algorithms formulate classification problems to classify pixels into forged or pristine. However, the definition of forged and…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Haiwei Wu , Yiming Chen , Jiantao Zhou , Yuanman Li

Contrastive learning (CL) has become a powerful approach for learning representations from unlabeled images. However, existing CL methods focus predominantly on visual appearance features while neglecting topological characteristics (e.g.,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Guangyu Meng , Pengfei Gu , Peixian Liang , John P. Lalor , Erin Wolf Chambers , Danny Z. Chen

Multi-label image classification presents a challenging task in many domains, including computer vision and medical imaging. Recent advancements have introduced graph-based and transformer-based methods to improve performance and capture…

Computer Vision and Pattern Recognition · Computer Science 2024-04-15 Ahmad Sajedi , Samir Khaki , Yuri A. Lawryshyn , Konstantinos N. Plataniotis

Contrastive learning and self-supervised techniques have gained prevalence in computer vision for the past few years. It is essential for medical image analysis, which is often notorious for its lack of annotations. Most existing…

Image and Video Processing · Electrical Eng. & Systems 2022-03-07 Jun Li , Quan Quan , S. Kevin Zhou

While deep learning has shown promise in the domain of disease classification from medical images, models based on state-of-the-art convolutional neural network architectures often exhibit performance loss due to dataset shift. Models…

Machine Learning · Computer Science 2020-01-14 Joseph D. Janizek , Gabriel Erion , Alex J. DeGrave , Su-In Lee

Magnetic Resonance Imaging (MRI) is an important medical imaging modality, while it requires a long acquisition time. To reduce the acquisition time, various methods have been proposed. However, these methods failed to reconstruct images…

Image and Video Processing · Electrical Eng. & Systems 2021-12-01 Qiaosi Yi , Jinhao Liu , Le Hu , Faming Fang , Guixu Zhang