English
Related papers

Related papers: Graph-Aware Contrasting for Multivariate Time-Seri…

200 papers

Graph contrastive learning has achieved great success in pre-training graph neural networks without ground-truth labels. Leading graph contrastive learning follows the classical scheme of contrastive learning, forcing model to identify the…

Machine Learning · Computer Science 2024-12-12 Junran Wu , Xueyuan Chen , Shangzhe Li

Forecasting the behaviour of complex dynamical systems such as interconnected sensor networks characterized by high-dimensional multivariate time series(MTS) is of paramount importance for making informed decisions and planning for the…

Machine Learning · Computer Science 2024-08-23 Sagar Srinivas Sakhinana , Shivam Gupta , Krishna Sai Sudhir Aripirala , Venkataramana Runkana

Video self-supervised learning is a challenging task, which requires significant expressive power from the model to leverage rich spatial-temporal knowledge and generate effective supervisory signals from large amounts of unlabeled videos.…

Computer Vision and Pattern Recognition · Computer Science 2023-07-19 Yang Liu , Keze Wang , Lingbo Liu , Haoyuan Lan , Liang Lin

Multimodal learning aims to imitate human beings to acquire complementary information from multiple modalities for various downstream tasks. However, traditional aggregation-based multimodal fusion methods ignore the inter-modality…

Computer Vision and Pattern Recognition · Computer Science 2023-05-17 Heqing Zou , Meng Shen , Chen Chen , Yuchen Hu , Deepu Rajan , Eng Siong Chng

Self-supervised pre-training with contrastive learning is a powerful method for learning from sparsely labeled data. However, performance can drop considerably when there is a shift in the distribution of data from training to test time. We…

Machine Learning · Computer Science 2026-01-13 Robert Lewis , Katie Matton , Rosalind W. Picard , John Guttag

We study time-series classification (TSC), a fundamental task of time-series data mining. Prior work has approached TSC from two major directions: (1) similarity-based methods that classify time-series based on the nearest neighbors, and…

Machine Learning · Computer Science 2022-01-07 Daochen Zha , Kwei-Herng Lai , Kaixiong Zhou , Xia Hu

Graph contrastive learning has emerged as a powerful tool for unsupervised graph representation learning. The key to the success of graph contrastive learning is to acquire high-quality positive and negative samples as contrasting pairs for…

Machine Learning · Computer Science 2023-05-19 Haoran Yang , Hongxu Chen , Sixiao Zhang , Xiangguo Sun , Qian Li , Xiangyu Zhao , Guandong Xu

Contrastive learning on graphs aims at extracting distinguishable high-level representations of nodes. In this paper, we theoretically illustrate that the entropy of a dataset can be approximated by maximizing the lower bound of the mutual…

Machine Learning · Computer Science 2023-07-27 Yixuan Ma , Xiaolin Zhang , Peng Zhang , Kun Zhan

Contrastive learning has revolutionized the field of computer vision, learning rich representations from unlabeled data, which generalize well to diverse vision tasks. Consequently, it has become increasingly important to explain these…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Fawaz Sammani , Boris Joukovsky , Nikos Deligiannis

Detecting anomalies in the data collected by WSNs can provide crucial evidence for assessing the reliability and stability of WSNs. Existing methods for WSN anomaly detection often face challenges such as the limited extraction of…

Machine Learning · Computer Science 2025-06-03 Miao Ye , Suxiao Wang , Jiaguang Han , Yong Wang , Xiaoli Wang , Jingxuan Wei , Peng Wen , Jing Cui

Self-supervised learning (SSL) has recently emerged as a powerful approach to learning representations from large-scale unlabeled data, showing promising results in time series analysis. The self-supervised representation learning can be…

Machine Learning · Computer Science 2024-03-18 Ziyu Liu , Azadeh Alavi , Minyi Li , Xiang Zhang

Mining natural associations from high-dimensional spatiotemporal signals plays an important role in various fields including biology, climatology, and financial analysis. However, most existing works have mainly studied time-independent…

Social and Information Networks · Computer Science 2020-12-08 Yueliang Liu , Wenbin Guo , Kangyong You , Lei Zhao , Tao Peng , Wenbo Wang

Graph contrastive learning (GCL) improves graph representation learning, leading to SOTA on various downstream tasks. The graph augmentation step is a vital but scarcely studied step of GCL. In this paper, we show that the node embedding…

Machine Learning · Computer Science 2022-06-14 Yifei Zhang , Hao Zhu , Zixing Song , Piotr Koniusz , Irwin King

Graph clustering, a classical task in graph learning, involves partitioning the nodes of a graph into distinct clusters. This task has applications in various real-world scenarios, such as anomaly detection, social network analysis, and…

Machine Learning · Computer Science 2024-08-09 Xiaoyang Ji , Yuchen Zhou , Haofu Yang , Shiyue Xu , Jiahao Li

Inspired by the successful application of contrastive learning on graphs, researchers attempt to impose graph contrastive learning approaches on heterogeneous information networks. Orthogonal to homogeneous graphs, the types of nodes and…

Machine Learning · Computer Science 2023-09-06 Yuanyuan Guo , Yu Xia , Rui Wang , Rongcheng Duan , Lu Li , Jiangmeng Li

The non-stationary nature of real-world Multivariate Time Series (MTS) data presents forecasting models with a formidable challenge of the time-variant distribution of time series, referred to as distribution shift. Existing studies on the…

Machine Learning · Computer Science 2024-07-19 Hui He , Qi Zhang , Kun Yi , Xiaojun Xue , Shoujin Wang , Liang Hu , Longbing Cao

Contrastive learning (CL) recently has spurred a fruitful line of research in the field of recommendation, since its ability to extract self-supervised signals from the raw data is well-aligned with recommender systems' needs for tackling…

Information Retrieval · Computer Science 2022-05-10 Junliang Yu , Hongzhi Yin , Xin Xia , Tong Chen , Lizhen Cui , Quoc Viet Hung Nguyen

Unsupervised graph representation learning is a non-trivial topic. The success of contrastive methods in the unsupervised representation learning on structured data inspires similar attempts on the graph. Existing graph contrastive learning…

Machine Learning · Computer Science 2024-04-02 Tianyu Zhang , Yuxiang Ren , Wenzheng Feng , Weitao Du , Xuecang Zhang

Unsupervised graph representation learning is critical to a wide range of applications where labels may be scarce or expensive to procure. Contrastive learning (CL) is an increasingly popular paradigm for such settings and the…

Machine Learning · Computer Science 2022-03-15 Puja Trivedi , Ekdeep Singh Lubana , Yujun Yan , Yaoqing Yang , Danai Koutra

Anomaly detection of time series, especially multivariate time series(time series with multiple sensors), has been focused on for several years. Though existing method has achieved great progress, there are several challenging problems to…

Machine Learning · Computer Science 2022-11-29 Weixuan Xiong , Xiaochen Sun