English
Related papers

Related papers: CARLA: Self-supervised Contrastive Representation …

200 papers

The continued digitization of societal processes translates into a proliferation of time series data that cover applications such as fraud detection, intrusion detection, and energy management, where anomaly detection is often essential to…

Self-supervised contrastive learning has emerged as a powerful tool in machine learning and computer vision to learn meaningful representations from unlabeled data. Meanwhile, its empirical success has encouraged many theoretical studies to…

Machine Learning · Computer Science 2025-05-29 Jingyi Cui , Hongwei Wen , Yisen Wang

A prominent technique for self-supervised representation learning has been to contrast semantically similar and dissimilar pairs of samples. Without access to labels, dissimilar (negative) points are typically taken to be randomly sampled…

Machine Learning · Computer Science 2020-10-22 Ching-Yao Chuang , Joshua Robinson , Lin Yen-Chen , Antonio Torralba , Stefanie Jegelka

Contrastive self-supervised learning (CSL) based on instance discrimination typically attracts positive samples while repelling negatives to learn representations with pre-defined binary self-supervision. However, vanilla CSL is inadequate…

Computer Vision and Pattern Recognition · Computer Science 2022-11-04 Yifei Zhang , Chang Liu , Yu Zhou , Weiping Wang , Qixiang Ye , Xiangyang Ji

Domain generalization aim to train models to effectively perform on samples that are unseen and outside of the distribution. Adversarial data augmentation (ADA) is a widely used technique in domain generalization. It enhances the model…

Machine Learning · Computer Science 2024-10-16 Byeong Tak Lee , Joon-myoung Kwon , Yong-Yeon Jo

Counterfactually Augmented Data (CAD) involves creating new data samples by applying minimal yet sufficient modifications to flip the label of existing data samples to other classes. Training with CAD enhances model robustness against…

Machine Learning · Computer Science 2024-06-12 Xiaoqi Qiu , Yongjie Wang , Xu Guo , Zhiwei Zeng , Yue Yu , Yuhong Feng , Chunyan Miao

Anomaly detection in time series has been widely researched and has important practical applications. In recent years, anomaly detection algorithms are mostly based on deep-learning generative models and use the reconstruction error to…

Machine Learning · Computer Science 2020-10-15 Chunkai Zhang , Wei Zuo , Xuan Wang

Anomaly detection aims to distinguish abnormal instances that deviate significantly from the majority of benign ones. As instances that appear in the real world are naturally connected and can be represented with graphs, graph neural…

Machine Learning · Computer Science 2023-05-24 Sheng Tian , Jihai Dong , Jintang Li , Wenlong Zhao , Xiaolong Xu , Baokun wang , Bowen Song , Changhua Meng , Tianyi Zhang , Liang Chen

Anomaly detection (AD), aiming to find samples that deviate from the training distribution, is essential in safety-critical applications. Though recent self-supervised learning based attempts achieve promising results by creating virtual…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Guodong Wang , Yunhong Wang , Jie Qin , Dongming Zhang , Xiuguo Bao , Di Huang

Despite recent advancements in deep learning, deep neural networks continue to suffer from performance degradation when applied to new data that differs from training data. Test-time adaptation (TTA) aims to address this challenge by…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Sanghun Jung , Jungsoo Lee , Nanhee Kim , Amirreza Shaban , Byron Boots , Jaegul Choo

While unsupervised change detection using contrastive learning has been significantly improved the performance of literature techniques, at present, it only focuses on the bi-temporal change detection scenario. Previous state-of-the-art…

Computer Vision and Pattern Recognition · Computer Science 2023-04-25 Yuxing Chen , Lorenzo Bruzzone

Collaborative learning enables distributed clients to learn a shared model for prediction while keeping the training data local on each client. However, existing collaborative learning methods require fully-labeled data for training, which…

Machine Learning · Computer Science 2022-04-26 Yawen Wu , Zhepeng Wang , Dewen Zeng , Meng Li , Yiyu Shi , Jingtong Hu

Anomaly detection of multivariate time series is meaningful for system behavior monitoring. This paper proposes an anomaly detection method based on unsupervised Short- and Long-term Mask Representation learning (SLMR). The main idea is to…

Machine Learning · Computer Science 2022-08-24 Qiucheng Miao , Chuanfu Xu , Jun Zhan , Dong Zhu , Chengkun Wu

Training in unsupervised time series anomaly detection is constantly plagued by the discrimination between harmful `anomaly contaminations' and beneficial `hard normal samples'. These two samples exhibit analogous loss behavior that…

Machine Learning · Computer Science 2026-03-17 Ruyi Zhang , Hongzuo Xu , Songlei Jian , Yusong Tan , Haifang Zhou , Rulin Xu

Video self-supervised learning is a challenging task, which requires significant expressive power from the model to leverage rich spatial-temporal knowledge and generate effective supervisory signals from large amounts of unlabeled videos.…

Computer Vision and Pattern Recognition · Computer Science 2023-07-19 Yang Liu , Keze Wang , Lingbo Liu , Haoyuan Lan , Liang Lin

Time series domain adaptation aims to transfer the complex temporal dependence from the labeled source domain to the unlabeled target domain. Recent advances leverage the stable causal mechanism over observed variables to model the…

Machine Learning · Computer Science 2025-02-25 Ruichu Cai , Junxian Huang , Zhenhui Yang , Zijian Li , Emadeldeen Eldele , Min Wu , Fuchun Sun

Unsupervised learning algorithms are beginning to achieve accuracies comparable to their supervised counterparts on benchmark computer vision tasks, but their utility for practical applications has not yet been demonstrated. In this work,…

Computer Vision and Pattern Recognition · Computer Science 2022-01-13 Jeremiah W. Johnson , Swathi Hari , Donald Hampton , Hyunju K. Connor , Amy Keesee

Temporal cues in videos provide important information for recognizing actions accurately. However, temporal-discriminative features can hardly be extracted without using an annotated large-scale video action dataset for training. This paper…

Computer Vision and Pattern Recognition · Computer Science 2020-08-06 Jinpeng Wang , Yiqi Lin , Andy J. Ma , Pong C. Yuen

Time Series Anomaly Detection (TSAD) is essential for uncovering rare and potentially harmful events in unlabeled time series data. Existing methods are highly dependent on clean, high-quality inputs, making them susceptible to noise and…

Machine Learning · Computer Science 2025-04-04 Sinchee Chin , Fan Zhang , Xiaochen Yang , Jing-Hao Xue , Wenming Yang , Peng Jia , Guijin Wang , Luo Yingqun

Deep learning-based 3D anomaly detection methods have demonstrated significant potential in industrial manufacturing. However, many approaches are specifically designed for anomaly detection tasks, which limits their generalizability to…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Yaohua Zha , Xue Yuerong , Chunlin Fan , Yuansong Wang , Tao Dai , Ke Chen , Shu-Tao Xia