English
Related papers

Related papers: Contrastive Learning-Based Dependency Modeling for…

200 papers

Anomaly detection on attributed networks aims to find the nodes whose behaviors are significantly different from other majority nodes. Generally, network data contains information about relationships between entities, and the anomaly is…

Social and Information Networks · Computer Science 2024-01-09 Enbo He , Yitong Hao , Yue Zhang , Guisheng Yin , Lina Yao

Contrastive learning has emerged as a competitive pretraining method for object detection. Despite this progress, there has been minimal investigation into the robustness of contrastively pretrained detectors when faced with domain shifts.…

Computer Vision and Pattern Recognition · Computer Science 2022-12-12 Kyle Buettner , Adriana Kovashka

Although the self-supervised pre-training of transformer models has resulted in the revolutionizing of natural language processing (NLP) applications and the achievement of state-of-the-art results with regard to various benchmarks, this…

Computation and Language · Computer Science 2023-01-26 Xiang Chen , Xin Xie , Zhen Bi , Hongbin Ye , Shumin Deng , Ningyu Zhang , Huajun Chen

Time-series representation learning can extract representations from data with temporal dynamics and sparse labels. When labeled data are sparse but unlabeled data are abundant, contrastive learning, i.e., a framework to learn a latent…

Machine Learning · Computer Science 2023-03-03 Heejeong Choi , Pilsung Kang

We focus on contrastive methods for self-supervised video representation learning. A common paradigm in contrastive learning is to construct positive pairs by sampling different data views for the same instance, with different data…

Computer Vision and Pattern Recognition · Computer Science 2021-08-23 Chen Sun , Arsha Nagrani , Yonglong Tian , Cordelia Schmid

Video anomaly detection is an essential yet challenging task in the multimedia community, with promising applications in smart cities and secure communities. Existing methods attempt to learn abstract representations of regular events with…

Multimedia · Computer Science 2023-08-04 Yang Liu , Zhaoyang Xia , Mengyang Zhao , Donglai Wei , Yuzheng Wang , Liu Siao , Bobo Ju , Gaoyun Fang , Jing Liu , Liang Song

Contrastive learning produces coherent semantic feature embeddings by encouraging positive samples to cluster closely while separating negative samples. However, existing contrastive learning methods lack principled guarantees on coverage…

Machine Learning · Computer Science 2026-03-30 Yahya Alkhatib , Wee Peng Tay

Recommender systems are essential for modern content platforms, yet traditional behavior-based models often struggle with cold users who have limited interaction data. Engaging these users is crucial for platform growth. To bridge this gap,…

Information Retrieval · Computer Science 2025-10-13 Lin Wang , Weisong Wang , Xuanji Xiao , Qing Li

In this work, we evaluate contrastive models for the task of image retrieval. We hypothesise that models that are learned to encode semantic similarity among instances via discriminative learning should perform well on the task of image…

Computer Vision and Pattern Recognition · Computer Science 2021-05-03 Tarun Krishna , Kevin McGuinness , Noel O'Connor

Operation and maintenance of large distributed cloud applications can quickly become unmanageably complex, putting human operators under immense stress when problems occur. Utilizing machine learning for identification and localization of…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-09-10 Dominik Scheinert , Alexander Acker , Lauritz Thamsen , Morgan K. Geldenhuys , Odej Kao

Despite great improvements in semantic segmentation, challenges persist because of the lack of local/global contexts and the relationship between them. In this paper, we propose Contextrast, a contrastive learning-based semantic…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Changki Sung , Wanhee Kim , Jungho An , Wooju Lee , Hyungtae Lim , Hyun Myung

Deep anomaly detection methods learn representations that separate between normal and anomalous images. Although self-supervised representation learning is commonly used, small dataset sizes limit its effectiveness. It was previously shown…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Tal Reiss , Yedid Hoshen

In this work, we aim to consider the application of contrastive learning in the scenario of the recommendation system adequately, making it more suitable for recommendation task. We propose a learning paradigm called supervised contrastive…

Information Retrieval · Computer Science 2022-04-20 Chun Yang

Contrastive learning has become pivotal in unsupervised representation learning, with frameworks like Momentum Contrast (MoCo) effectively utilizing large negative sample sets to extract discriminative features. However, traditional…

Machine Learning · Computer Science 2025-01-29 Duy Hoang , Huy Ngo , Khoi Pham , Tri Nguyen , Gia Bao , Huy Phan

Classical machine learners are designed only to tackle one task without capability of adopting new emerging tasks or classes whereas such capacity is more practical and human-like in the real world. To address this shortcoming, continual…

Machine Learning · Computer Science 2021-12-06 Xuejun Han , Yuhong Guo

Multimodal models, such as the Contrastive Language-Image Pre-training (CLIP) model, have demonstrated remarkable success in aligning visual and linguistic representations. However, these models exhibit limitations when applied to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Hiroshi Sasaki

Graph contrastive learning is a general learning paradigm excelling at capturing invariant information from diverse perturbations in graphs. Recent works focus on exploring the structural rationale from graphs, thereby increasing the…

Machine Learning · Computer Science 2024-04-09 Qirui Ji , Jiangmeng Li , Jie Hu , Rui Wang , Changwen Zheng , Fanjiang Xu

Detecting anomalies in traffic scenes is crucial for ensuring safety in autonomous driving, yet collecting representative anomalous data remains challenging. Existing anomaly detection methods are highly specialized and rely on normality as…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Albert Schotschneider , Daniel Bogdoll , Svetlana Pavlitska , Ahmed Abouelazm , Johann Marius Zoellner

Most advanced unsupervised anomaly detection (UAD) methods rely on modeling feature representations of frozen encoder networks pre-trained on large-scale datasets, e.g. ImageNet. However, the features extracted from the encoders that are…

Computer Vision and Pattern Recognition · Computer Science 2023-10-25 Jia Guo , Shuai Lu , Lize Jia , Weihang Zhang , Huiqi Li

We address the problem of anomaly detection, that is, detecting anomalous events in a video sequence. Anomaly detection methods based on convolutional neural networks (CNNs) typically leverage proxy tasks, such as reconstructing input video…

Computer Vision and Pattern Recognition · Computer Science 2020-03-31 Hyunjong Park , Jongyoun Noh , Bumsub Ham