English
Related papers

Related papers: LEARNER: Contrastive Pretraining for Learning Fine…

200 papers

Recently, pretext-task based methods are proposed one after another in self-supervised video feature learning. Meanwhile, contrastive learning methods also yield good performance. Usually, new methods can beat previous ones as claimed that…

Computer Vision and Pattern Recognition · Computer Science 2021-04-06 Li Tao , Xueting Wang , Toshihiko Yamasaki

A data augmentation module is utilized in contrastive learning to transform the given data example into two views, which is considered essential and irreplaceable. However, the predetermined composition of multiple data augmentations brings…

Computer Vision and Pattern Recognition · Computer Science 2022-08-23 Junbo Zhang , Kaisheng Ma

There are not many large medical image datasets available. For these datasets, too small deep learning models can't learn useful features, so they don't work well due to underfitting, and too big models tend to overfit the limited data. As…

Image and Video Processing · Electrical Eng. & Systems 2023-11-02 Pervaiz Iqbal Khan , Andreas Dengel , Sheraz Ahmed

This study compares various superlearner and deep learning architectures (machine-learning-based and neural-network-based) for classification problems across several simulated and industrial datasets to assess performance and computational…

Machine Learning · Statistics 2017-08-23 Colleen M. Farrelly

Despite the remarkable advances in deep learning technology, achieving satisfactory performance in lung sound classification remains a challenge due to the scarcity of available data. Moreover, the respiratory sound samples are collected…

Sound · Computer Science 2023-12-18 June-Woo Kim , Sangmin Bae , Won-Yang Cho , Byungjo Lee , Ho-Young Jung

Recent multimodal models such as Contrastive Language-Image Pre-training (CLIP) have shown remarkable ability to align visual and linguistic representations. However, domains where small visual differences carry large semantic significance,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Hiroshi Sasaki

The evaluation of white matter lesion progression is an important biomarker in the follow-up of MS patients and plays a crucial role when deciding the course of treatment. Current automated lesion segmentation algorithms are susceptible to…

Image and Video Processing · Electrical Eng. & Systems 2020-10-28 Mattias Billast , Maria Ines Meyer , Diana M. Sima , David Robben

Deep learning with noisy labels is an interesting challenge in weakly supervised learning. Despite their significant learning capacity, CNNs have a tendency to overfit in the presence of samples with noisy labels. Alleviating this issue,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-06 Yan Han , Soumava Kumar Roy , Mehrtash Harandi , Lars Petersson

Preserving maximal information is one of principles of designing self-supervised learning methodologies. To reach this goal, contrastive learning adopts an implicit way which is contrasting image pairs. However, we believe it is not fully…

Computer Vision and Pattern Recognition · Computer Science 2022-04-14 Hong-Yu Zhou , Chixiang Lu , Sibei Yang , Xiaoguang Han , Yizhou Yu

Neural predictors have shown great potential in the evaluation process of neural architecture search (NAS). However, current predictor-based approaches overlook the fact that training a predictor necessitates a considerable number of…

Machine Learning · Computer Science 2023-12-15 Shenghe Zheng , Hongzhi Wang , Tianyu Mu

A key challenge in training neural networks for a given medical imaging task is often the difficulty of obtaining a sufficient number of manually labeled examples. In contrast, textual imaging reports, which are often readily available in…

Machine Learning · Computer Science 2022-01-31 Gongbo Liang , Connor Greenwell , Yu Zhang , Xiaoqin Wang , Ramakanth Kavuluru , Nathan Jacobs

Deep neural networks excel at comprehending complex visual signals, delivering on par or even superior performance to that of human experts. However, ad-hoc visual explanations of model decisions often reveal an alarming level of reliance…

Computer Vision and Pattern Recognition · Computer Science 2021-05-03 Dong Wang , Yuewei Yang , Chenyang Tao , Zhe Gan , Liqun Chen , Fanjie Kong , Ricardo Henao , Lawrence Carin

Within the intensive care unit (ICU), a wealth of patient data, including clinical measurements and clinical notes, is readily available. This data is a valuable resource for comprehending patient health and informing medical decisions, but…

Machine Learning · Computer Science 2023-12-13 Ryan King , Tianbao Yang , Bobak Mortazavi

Contrastive self-supervised learning (CSL) has attracted increasing attention for model pre-training via unlabeled data. The resulted CSL models provide instance-discriminative visual features that are uniformly scattered in the feature…

Computer Vision and Pattern Recognition · Computer Science 2021-10-15 Yifan Zhang , Bryan Hooi , Dapeng Hu , Jian Liang , Jiashi Feng

The integration of artificial intelligence [AI] into clinical trials has revolutionized the process of drug development and personalized medicine. Among these advancements, deep learning and predictive modelling have emerged as…

Machine Learning · Computer Science 2024-12-11 Sydney Anuyah , Mallika K Singh , Hope Nyavor

Medical image segmentation has been widely recognized as a pivot procedure for clinical diagnosis, analysis, and treatment planning. However, the laborious and expensive annotation process lags down the speed of further advances.…

Computer Vision and Pattern Recognition · Computer Science 2022-05-02 Zhuowei Li , Zihao Liu , Zhiqiang Hu , Qing Xia , Ruiqin Xiong , Shaoting Zhang , Dimitris Metaxas , Tingting Jiang

Cross-lingual named entity recognition (CrossNER) faces challenges stemming from uneven performance due to the scarcity of multilingual corpora, especially for non-English data. While prior efforts mainly focus on data-driven transfer…

Computation and Language · Computer Science 2024-02-22 Ying Mo , Jian Yang , Jiahao Liu , Qifan Wang , Ruoyu Chen , Jingang Wang , Zhoujun Li

Sequential recommendation methods play a crucial role in modern recommender systems because of their ability to capture a user's dynamic interest from her/his historical interactions. Despite their success, we argue that these approaches…

Information Retrieval · Computer Science 2021-03-02 Xu Xie , Fei Sun , Zhaoyang Liu , Shiwen Wu , Jinyang Gao , Bolin Ding , Bin Cui

Acceleration of machine learning research in healthcare is challenged by lack of large annotated and balanced datasets. Furthermore, dealing with measurement inaccuracies and exploiting unsupervised data are considered to be central to…

Signal Processing · Electrical Eng. & Systems 2019-01-11 Deepta Rajan , David Beymer , Girish Narayan

Previous approaches to the task of implicit discourse relation recognition (IDRR) generally view it as a classification task. Even with pre-trained language models, like BERT and RoBERTa, IDRR still relies on complicated neural networks…

Computation and Language · Computer Science 2024-09-24 Yiheng Wu , Junhui Li , Muhua Zhu