English
Related papers

Related papers: Spectral Temporal Contrastive Learning

200 papers

Universal time series representation learning is challenging but valuable in real-world applications such as classification, anomaly detection, and forecasting. Recently, contrastive learning (CL) has been actively explored to tackle time…

Machine Learning · Computer Science 2025-02-06 Namwoo Kim , Hyungryul Baik , Yoonjin Yoon

Recently, various contrastive learning techniques have been developed to categorize time series data and exhibit promising performance. A general paradigm is to utilize appropriate augmentations and construct feasible positive samples such…

Machine Learning · Computer Science 2024-10-11 Qianying Ren , Dongsheng Luo , Dongjin Song

Contrastive learning (CL) is a popular technique for self-supervised learning (SSL) of visual representations. It uses pairs of augmentations of unlabeled training examples to define a classification task for pretext learning of a deep…

Computer Vision and Pattern Recognition · Computer Science 2020-10-26 Chih-Hui Ho , Nuno Vasconcelos

Graph contrastive learning (GCL) has become a powerful tool for learning graph data, but its scalability remains a significant challenge. In this work, we propose a simple yet effective training framework called Structural Compression…

Machine Learning · Computer Science 2024-05-10 Shengzhong Zhang , Wenjie Yang , Xinyuan Cao , Hongwei Zhang , Zengfeng Huang

Recently, contrastive learning (CL), a technique most prominently used in natural language and computer vision, has been used to train informative representation spaces for galaxy spectra and images in a self-supervised manner. Following…

Solar and Stellar Astrophysics · Physics 2024-11-19 Tobias Buck , Christian Schwarz

Graph Contrastive Learning (GCL) excels at managing noise and fluctuations in input data, making it popular in various fields (e.g., social networks, and knowledge graphs). Our study finds that the difference in high-frequency information…

Machine Learning · Computer Science 2024-10-15 Yuntao Shou , Xiangyong Cao , Deyu Meng

Contrastive learning -- a modern approach to extract useful representations from unlabeled data by training models to distinguish similar samples from dissimilar ones -- has driven significant progress in foundation models. In this work, we…

Machine Learning · Statistics 2025-10-15 Licong Lin , Song Mei

Recently the deep learning has shown its advantage in representation learning and clustering for time series data. Despite the considerable progress, the existing deep time series clustering approaches mostly seek to train the deep neural…

Machine Learning · Computer Science 2023-01-02 Ying Zhong , Dong Huang , Chang-Dong Wang

Node classification is a key task in temporal graph learning (TGL). Real-life temporal graphs often introduce new node classes over time, but existing TGL methods assume a fixed set of classes. This assumption brings limitations, as…

Machine Learning · Computer Science 2025-03-04 Hanmo Liu , Shimin Di , Haoyang Li , Xun Jian , Yue Wang , Lei Chen

To improve the detection accuracy and generalization of steganalysis, this paper proposes the Steganalysis Contrastive Framework (SCF) based on contrastive learning. The SCF improves the feature representation of steganalysis by maximizing…

Artificial Intelligence · Computer Science 2021-03-02 Yanzhen Ren , Yiwen Liu , Lina Wang

Graph contrastive learning (GCL) aligns node representations by classifying node pairs into positives and negatives using a selection process that typically relies on establishing correspondences within two augmented graphs. The…

Machine Learning · Computer Science 2024-11-27 Maysam Behmanesh , Maks Ovsjanikov

Supervised deep learning needs a large amount of labeled data to achieve high performance. However, in medical imaging analysis, each site may only have a limited amount of data and labels, which makes learning ineffective. Federated…

Image and Video Processing · Electrical Eng. & Systems 2022-04-26 Yawen Wu , Dewen Zeng , Zhepeng Wang , Yiyu Shi , Jingtong Hu

Graph contrastive learning (GCL) is an effective paradigm for node representation learning in graphs. The key components hidden behind GCL are data augmentation and positive-negative pair selection. Typical data augmentations in GCL, such…

Machine Learning · Computer Science 2024-07-25 Jiaqiang Zhang , Songcan Chen

Contrastive self-supervised learning (SSL) learns an embedding space that maps similar data pairs closer and dissimilar data pairs farther apart. Despite its success, one issue has been overlooked: the fairness aspect of representations…

Contrastive Learning (CL) performances as a rising approach to address the challenge of sparse and noisy recommendation data. Although having achieved promising results, most existing CL methods only perform either hand-crafted data or…

Information Retrieval · Computer Science 2023-11-22 Xiuyuan Qin , Huanhuan Yuan , Pengpeng Zhao , Junhua Fang , Fuzhen Zhuang , Guanfeng Liu , Victor Sheng

Contrastive Learning (CL) has been proved to be a powerful self-supervised approach for a wide range of domains, including computer vision and graph representation learning. However, the incremental learning issue of CL has rarely been…

Machine Learning · Computer Science 2023-01-31 Cheng Ji , Jianxin Li , Hao Peng , Jia Wu , Xingcheng Fu , Qingyun Sun , Phillip S. Yu

Temporal Graph Learning (TGL) is crucial for capturing the evolving nature of stock markets. Traditional methods often ignore the interplay between dynamic temporal changes and static relational structures between stocks. To address this…

Machine Learning · Computer Science 2025-03-04 Yunhua Pei , Jin Zheng , John Cartlidge

Dynamic graph modeling has recently attracted much attention due to its extensive applications in many real-world scenarios, such as recommendation systems, financial transactions, and social networks. Although many works have been proposed…

Machine Learning · Computer Science 2021-05-18 Lu Wang , Xiaofu Chang , Shuang Li , Yunfei Chu , Hui Li , Wei Zhang , Xiaofeng He , Le Song , Jingren Zhou , Hongxia Yang

Contrastive representation learning (CRL) underpins many modern foundation models. Despite recent theoretical progress, existing analyses suffer from several key limitations: (i) the statistical consistency of CRL remains poorly understood;…

Machine Learning · Computer Science 2026-05-29 Yuanfan Li , Xiyuan Wei , Tianbao Yang , Yiming Ying

Graphs serve as versatile data structures in numerous real-world domains-including social networks, molecular biology, and knowledge graphs-by capturing intricate relational information among entities. Among graph-based learning techniques,…

Machine Learning · Computer Science 2025-05-21 Chou-Ying Hsieh , Chun-Fu Jang , Cheng-En Hsieh , Qian-Hui Chen , Sy-Yen Kuo