English
Related papers

Related papers: CSI: Contrastive Data Stratification for Interacti…

200 papers

Contrastively trained vision-language models have achieved remarkable progress in vision and language representation learning, leading to state-of-the-art models for various downstream multimodal tasks. However, recent research has…

Computation and Language · Computer Science 2023-10-26 Harman Singh , Pengchuan Zhang , Qifan Wang , Mengjiao Wang , Wenhan Xiong , Jingfei Du , Yu Chen

Numerous cellular functions rely on protein$\unicode{x2013}$protein interactions. Efforts to comprehensively characterize them remain challenged however by the diversity of molecular recognition mechanisms employed within the proteome. Deep…

Biomolecules · Quantitative Biology 2023-12-08 Julia R. Rogers , Gergő Nikolényi , Mohammed AlQuraishi

Self-supervised learning enables networks to learn discriminative features from massive data itself. Most state-of-the-art methods maximize the similarity between two augmentations of one image based on contrastive learning. By utilizing…

Computer Vision and Pattern Recognition · Computer Science 2023-07-05 Jidong Ge , Yuxiang Liu , Jie Gui , Lanting Fang , Ming Lin , James Tin-Yau Kwok , LiGuo Huang , Bin Luo

Learning scientific document representations can be substantially improved through contrastive learning objectives, where the challenge lies in creating positive and negative training samples that encode the desired similarity semantics.…

Computation and Language · Computer Science 2022-10-20 Malte Ostendorff , Nils Rethmeier , Isabelle Augenstein , Bela Gipp , Georg Rehm

Typical methods for pedestrian detection focus on either tackling mutual occlusions between crowded pedestrians, or dealing with the various scales of pedestrians. Detecting pedestrians with substantial appearance diversities such as…

Computer Vision and Pattern Recognition · Computer Science 2022-07-12 Zebin Lin , Wenjie Pei , Fanglin Chen , David Zhang , Guangming Lu

Recent contrastive representation learning methods rely on estimating mutual information (MI) between multiple views of an underlying context. E.g., we can derive multiple views of a given image by applying data augmentation, or we can…

Machine Learning · Computer Science 2021-06-28 Alessandro Sordoni , Nouha Dziri , Hannes Schulz , Geoff Gordon , Phil Bachman , Remi Tachet

Contrastive learning has been used to learn a high-quality representation of the image in computer vision. However, contrastive learning is not widely utilized in natural language processing due to the lack of a general method of data…

Computation and Language · Computer Science 2021-04-29 Peng Su , Yifan Peng , K. Vijay-Shanker

Intent is a significant latent factor influencing user-item interaction sequences. Prevalent sequence recommendation models that utilize contrastive learning predominantly rely on single-intent representations to direct the training…

Machine Learning · Computer Science 2024-09-16 Junshu Huang , Zi Long , Xianghua Fu , Yin Chen

Human-Object Interaction detection is a holistic visual recognition task that entails object detection as well as interaction classification. Previous works of HOI detection has been addressed by the various compositions of subset…

Computer Vision and Pattern Recognition · Computer Science 2022-04-12 Jihwan Park , SeungJun Lee , Hwan Heo , Hyeong Kyu Choi , Hyunwoo J. Kim

With the perpetual increase of complexity of the state-of-the-art deep neural networks, it becomes a more and more challenging task to maintain their interpretability. Our work aims to evaluate the effects of adversarial training utilized…

Computer Vision and Pattern Recognition · Computer Science 2023-11-21 Delyan Boychev

Link prediction tasks focus on predicting possible future connections. Most existing researches measure the likelihood of links by different similarity scores on node pairs and predict links between nodes. However, the similarity-based…

Machine Learning · Computer Science 2023-03-09 Zehua Zhang , Shilin Sun , Guixiang Ma , Caiming Zhong

Contrastive learning is a powerful framework for learning self-supervised representations that generalize well to downstream supervised tasks. We show that multiple existing contrastive learning methods can be reinterpreted as learning…

Machine Learning · Computer Science 2023-02-16 Daniel D. Johnson , Ayoub El Hanchi , Chris J. Maddison

In the task of Object Recognition, there exists a dichotomy between the categorization of objects and estimating object pose, where the former necessitates a view-invariant representation, while the latter requires a representation capable…

Computer Vision and Pattern Recognition · Computer Science 2016-04-20 Mohamed Elhoseiny , Tarek El-Gaaly , Amr Bakry , Ahmed Elgammal

Unsupervised representation learning has recently received lots of interest due to its powerful generalizability through effectively leveraging large-scale unlabeled data. There are two prevalent approaches for this, contrastive learning…

Machine Learning · Computer Science 2021-06-14 Saehoon Kim , Sungwoong Kim , Juho Lee

Graph-level contrastive learning, aiming to learn the representations for each graph by contrasting two augmented graphs, has attracted considerable attention. Previous studies usually simply assume that a graph and its augmented graph as a…

Artificial Intelligence · Computer Science 2024-04-15 Yanbei Liu , Yu Zhao , Xiao Wang , Lei Geng , Zhitao Xiao

Noise contrastive learning is a popular technique for unsupervised representation learning. In this approach, a representation is obtained via reduction to supervised learning, where given a notion of semantic similarity, the learner tries…

Machine Learning · Computer Science 2021-06-21 Jordan T. Ash , Surbhi Goel , Akshay Krishnamurthy , Dipendra Misra

Conversational recommender systems (CRS) aim to recommend suitable items to users through natural language conversations. For developing effective CRSs, a major technical issue is how to accurately infer user preference from very limited…

Computation and Language · Computer Science 2023-05-31 Yuanhang Zhou , Kun Zhou , Wayne Xin Zhao , Cheng Wang , Peng Jiang , He Hu

High-throughput protein interaction detection methods are strongly affected by false positive and false negative results. Focused experiments are needed to complement the large-scale methods by validating previously detected interactions…

Molecular Networks · Quantitative Biology 2007-05-23 Istvan Albert , Reka Albert

Common-sense physical reasoning is an essential ingredient for any intelligent agent operating in the real-world. For example, it can be used to simulate the environment, or to infer the state of parts of the world that are currently…

Machine Learning · Computer Science 2018-03-01 Sjoerd van Steenkiste , Michael Chang , Klaus Greff , Jürgen Schmidhuber

Many recent approaches in contrastive learning have worked to close the gap between pretraining on iconic images like ImageNet and pretraining on complex scenes like COCO. This gap exists largely because commonly used random crop…

Computer Vision and Pattern Recognition · Computer Science 2022-08-17 Renhao Wang , Hang Zhao , Yang Gao