English
Related papers

Related papers: Bootstrapping Your Own Positive Sample: Contrastiv…

200 papers

With the onset of the COVID-19 pandemic, ultrasound has emerged as an effective tool for bedside monitoring of patients. Due to this, a large amount of lung ultrasound scans have been made available which can be used for AI based diagnosis…

Image and Video Processing · Electrical Eng. & Systems 2022-01-20 Gautam Rajendrakumar Gare , Hai V. Tran , Bennett P deBoisblanc , Ricardo Luis Rodriguez , John Michael Galeotti

A key requirement for the success of supervised deep learning is a large labeled dataset - a condition that is difficult to meet in medical image analysis. Self-supervised learning (SSL) can help in this regard by providing a strategy to…

Computer Vision and Pattern Recognition · Computer Science 2020-11-02 Krishna Chaitanya , Ertunc Erdil , Neerav Karani , Ender Konukoglu

Industrial and medical anomaly detection faces critical challenges from data scarcity and prohibitive annotation costs, particularly in evolving manufacturing and healthcare settings. To address this, we propose CoZAD, a novel zero-shot…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Muhammad Aqeel , Danijel Skocaj , Marco Cristani , Francesco Setti

Contrastive learning has emerged as an essential approach for self-supervised learning in visual representation learning. The central objective of contrastive learning is to maximize the similarities between two augmented versions of an…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Hengkui Dong , Xianzhong Long , Yun Li , Lei Chen

Recently, contrastive learning has risen to be a promising approach for large-scale self-supervised learning. However, theoretical understanding of how it works is still unclear. In this paper, we propose a new guarantee on the downstream…

Machine Learning · Computer Science 2022-05-30 Yifei Wang , Qi Zhang , Yisen Wang , Jiansheng Yang , Zhouchen Lin

Contrastive learning has been shown to produce generalizable representations of audio and visual data by maximizing the lower bound on the mutual information (MI) between different views of an instance. However, obtaining a tight lower…

Machine Learning · Computer Science 2021-04-20 Shuang Ma , Zhaoyang Zeng , Daniel McDuff , Yale Song

Human Activity Recognition (HAR) constitutes one of the most important tasks for wearable and mobile sensing given its implications in human well-being and health monitoring. Motivated by the limitations of labeled datasets in HAR,…

Machine Learning · Computer Science 2021-02-12 Chi Ian Tang , Ignacio Perez-Pozuelo , Dimitris Spathis , Cecilia Mascolo

Recent contrastive methods show significant improvement in self-supervised learning in several domains. In particular, contrastive methods are most effective where data augmentation can be easily constructed e.g. in computer vision.…

Machine Learning · Computer Science 2021-12-09 Konstantinos Kallidromitis , Denis Gudovskiy , Kazuki Kozuka , Iku Ohama , Luca Rigazio

The classification of mental health is challenging for a variety of reasons. For one, there is overlap between the mental health issues. In addition, the signs of mental health issues depend on the context of the situation, making…

Machine Learning · Computer Science 2026-03-17 Menna Elgabry , Ali Hamdi , Khaled Shaban

We introduce a novel contrastive representation learning objective and a training scheme for clinical time series. Specifically, we project high dimensional EHR. data to a closed unit ball of low dimension, encoding geometric priors so that…

Machine Learning · Computer Science 2022-07-05 Thesath Nanayakkara , Gilles Clermont , Christopher James Langmead , David Swigon

Objectives: Electronic health records (EHRs) are only a first step in capturing and utilizing health-related data - the challenge is turning that data into useful information. Furthermore, EHRs are increasingly likely to include data…

Artificial Intelligence · Computer Science 2012-08-20 Casey Bennett , Tom Doub , Rebecca Selove

Contrastive learning is emerging as a powerful technique for extracting knowledge from unlabeled data. This technique requires a balanced mixture of two ingredients: positive (similar) and negative (dissimilar) samples. This is typically…

Computation and Language · Computer Science 2022-03-17 Rui Cao , Yihao Wang , Yuxin Liang , Ling Gao , Jie Zheng , Jie Ren , Zheng Wang

The electrocardiogram (ECG) is a fundamental tool in cardiovascular diagnostics due to its powerful and non-invasive nature. One of the most critical usages is to determine whether more detailed examinations are necessary, with users…

Artificial Intelligence · Computer Science 2025-04-15 Junichiro Takahashi , JingChuan Guan , Masataka Sato , Kaito Baba , Kazuto Haruguchi , Daichi Nagashima , Satoshi Kodera , Norihiko Takeda

Electronic Health Records (EHRs) are commonly used by the machine learning community for research on problems specifically related to health care and medicine. EHRs have the advantages that they can be easily distributed and contain many…

Machine Learning · Computer Science 2020-06-08 Kieran Chin-Cheong , Thomas Sutter , Julia E. Vogt

Electronic Health Record (EHR) data can be represented as discrete counts over a high dimensional set of possible procedures, diagnoses, and medications. Supervised topic models present an attractive option for incorporating EHR data as…

Machine Learning · Computer Science 2019-11-21 Jason Ren , Russell Kunes , Finale Doshi-Velez

Recently, self-supervised representation learning gives further development in multimedia technology. Most existing self-supervised learning methods are applicable to packaged data. However, when it comes to streamed data, they are…

Computer Vision and Pattern Recognition · Computer Science 2022-11-03 Zhiwei Lin , Yongtao Wang , Hongxiang Lin

Learning from longitudinal electronic health records is limited if it does not capture the temporal trajectories of the patient's state in a clinical setting. Graph models allow us to capture the hidden dependencies of the multivariate…

Machine Learning · Computer Science 2025-03-31 Munib Mesinovic , Soheila Molaei , Peter Watkinson , Tingting Zhu

Predicting whether a treatment leads to meaningful improvement is a central challenge in personalized medicine, particularly when disease progression manifests as subtle visual changes over time. While data-driven deep learning (DL) offers…

Image and Video Processing · Electrical Eng. & Systems 2025-11-21 Jana Armouti , Nikhil Madaan , Rohan Panda , Tom Fox , Laura Hutchins , Amita Krishnan , Ricardo Rodriguez , Bennett DeBoisblanc , Deva Ramanan , John Galeotti , Gautam Gare

Self-supervised contrastive learning between pairs of multiple views of the same image has been shown to successfully leverage unlabeled data to produce meaningful visual representations for both natural and medical images. However, there…

Image and Video Processing · Electrical Eng. & Systems 2021-10-19 Yen Nhi Truong Vu , Richard Wang , Niranjan Balachandar , Can Liu , Andrew Y. Ng , Pranav Rajpurkar

Recent work studies the supervised online continual learning setting where a learner receives a stream of data whose class distribution changes over time. Distinct from other continual learning settings the learner is presented new samples…

Machine Learning · Computer Science 2022-03-28 Nader Asadi , Sudhir Mudur , Eugene Belilovsky