English
Related papers

Related papers: CLDR: Contrastive Learning Drug Response Models fr…

200 papers

Well-annotated medical datasets enable deep neural networks (DNNs) to gain strong power in extracting lesion-related features. Building such large and well-designed medical datasets is costly due to the need for high-level expertise. Model…

Computer Vision and Pattern Recognition · Computer Science 2022-12-09 Yixiong Chen , Chunhui Zhang , Chris H. Q. Ding , Li Liu

Contrastive learning (CL) has been successful as a powerful representation learning method. In this paper, we propose a contrastive learning framework for cross-domain sentiment classification. We aim to induce domain invariant optimal…

Computation and Language · Computer Science 2020-12-08 Tian Li , Xiang Chen , Shanghang Zhang , Zhen Dong , Kurt Keutzer

Augmentation techniques and sampling strategies are crucial in contrastive learning, but in most existing works, augmentation techniques require careful design, and their sampling strategies can only capture a small amount of intrinsic…

Machine Learning · Computer Science 2023-07-28 Yixian Ma , Kun Zhan

Dynamic treatment recommendation systems based on large-scale electronic health records (EHRs) become a key to successfully improve practical clinical outcomes. Prior relevant studies recommend treatments either use supervised learning…

Machine Learning · Computer Science 2018-09-18 Lu Wang , Wei Zhang , Xiaofeng He , Hongyuan Zha

CLIP (Contrastive Language-Image Pre-training) uses contrastive learning from noise image-text pairs to excel at recognizing a wide array of candidates, yet its focus on broad associations hinders the precision in distinguishing subtle…

Computer Vision and Pattern Recognition · Computer Science 2026-05-18 Ziyu Liu , Zeyi Sun , Yuhang Zang , Wei Li , Pan Zhang , Xiaoyi Dong , Yuanjun Xiong , Dahua Lin , Jiaqi Wang

The proliferation of Deep Learning (DL)-based methods for radiographic image analysis has created a great demand for expert-labeled radiology data. Recent self-supervised frameworks have alleviated the need for expert labeling by obtaining…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 S. A. Rizvi , R. Tang , X. Jiang , X. Ma , X. Hu

Image super-resolution (SR) research has witnessed impressive progress thanks to the advance of convolutional neural networks (CNNs) in recent years. However, most existing SR methods are non-blind and assume that degradation has a single…

Computer Vision and Pattern Recognition · Computer Science 2021-07-05 Jiahui Zhang , Shijian Lu , Fangneng Zhan , Yingchen Yu

The impressive performance of GPT-3 using natural language prompts and in-context learning has inspired work on better fine-tuning of moderately-sized models under this paradigm. Following this line of work, we present a contrastive…

Computation and Language · Computer Science 2022-05-04 Yiren Jian , Chongyang Gao , Soroush Vosoughi

Deep learning models are known to be vulnerable to adversarial examples that are elaborately designed for malicious purposes and are imperceptible to the human perceptual system. Autoencoder, when trained solely over benign examples, has…

Computer Vision and Pattern Recognition · Computer Science 2022-08-30 Zhaoxi Zhang , Leo Yu Zhang , Xufei Zheng , Jinyu Tian , Jiantao Zhou

This paper presents SimCLR: a simple framework for contrastive learning of visual representations. We simplify recently proposed contrastive self-supervised learning algorithms without requiring specialized architectures or a memory bank.…

Machine Learning · Computer Science 2020-07-02 Ting Chen , Simon Kornblith , Mohammad Norouzi , Geoffrey Hinton

In meta reinforcement learning (meta RL), an agent seeks a Bayes-optimal policy -- the optimal policy when facing an unknown task that is sampled from some known task distribution. Previous approaches tackled this problem by inferring a…

Machine Learning · Computer Science 2023-06-06 Era Choshen , Aviv Tamar

Contrastive learning has achieved remarkable success in representation learning via self-supervision in unsupervised settings. However, effectively adapting contrastive learning to supervised learning tasks remains as a challenge in…

Computation and Language · Computer Science 2022-01-24 Qianben Chen , Richong Zhang , Yaowei Zheng , Yongyi Mao

GNN-based methods have achieved excellent results as a mainstream task in drug response prediction tasks in recent years. Traditional GNN methods use only the atoms in a drug molecule as nodes to obtain the representation of the molecular…

Biomolecules · Quantitative Biology 2024-12-12 Kun Li , Jia Wu , Bo Du , Sergey V. Petoukhov , Huiting Xu , Zheman Xiao , Wenbin Hu

Contrastive language-audio pretraining, which aims to unify multimodal representations in a shared embedding space, serves as a cornerstone for building a wide range of applications, from cross-modal retrieval to cutting-edge multimodal…

Non-overlapping Cross-domain Sequential Recommendation (NCSR) is the task that focuses on domain knowledge transfer without overlapping entities. Compared with traditional Cross-domain Sequential Recommendation (CSR), NCSR poses several…

Information Retrieval · Computer Science 2025-11-25 Lei Guo , Chenlong Song , Feng Guo , Xiaohui Han , Xiaojun Chang , Lei Zhu

Binary code representation learning has shown significant performance in binary analysis tasks. But existing solutions often have poor transferability, particularly in few-shot and zero-shot scenarios where few or no training samples are…

Software Engineering · Computer Science 2024-02-28 Hao Wang , Zeyu Gao , Chao Zhang , Zihan Sha , Mingyang Sun , Yuchen Zhou , Wenyu Zhu , Wenju Sun , Han Qiu , Xi Xiao

Distribution Matching Distillation (DMD) facilitates efficient inference by distilling multi-step diffusion models into few-step variants. Concurrently, Reinforcement Learning (RL) has emerged as a vital tool for aligning generative models…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Dengyang Jiang , Dongyang Liu , Zanyi Wang , Qilong Wu , Liuzhuozheng Li , Hengzhuang Li , Xin Jin , David Liu , Changsheng Lu , Zhen Li , Bo Zhang , Mengmeng Wang , Steven Hoi , Peng Gao , Harry Yang

Multilingual representations pre-trained with monolingual data exhibit considerably unequal task performances across languages. Previous studies address this challenge with resource-intensive contextualized alignment, which assumes the…

Computation and Language · Computer Science 2022-09-20 Wei Zhao , Steffen Eger

Deep Learning (DL) is considered the state-of-the-art in computer vision, speech recognition and natural language processing. Until recently, it was also widely accepted that DL is irrelevant for learning tasks on tabular data, especially…

Machine Learning · Computer Science 2021-06-30 Karim Lounici , Katia Meziani , Benjamin Riu

Dimensionality reduction methods are unsupervised approaches which learn low-dimensional spaces where some properties of the initial space, typically the notion of "neighborhood", are preserved. Such methods usually require propagation on…

Computer Vision and Pattern Recognition · Computer Science 2022-06-16 Yannis Kalantidis , Carlos Lassance , Jon Almazan , Diane Larlus