中文
相关论文

相关论文: Distillation Enhanced Time Series Forecasting Netw…

200 篇论文

In this work, we investigate the time series representation learning problem using self-supervised techniques. Contrastive learning is well-known in this area as it is a powerful method for extracting information from the series and…

机器学习 · 计算机科学 2024-10-08 Duy A. Nguyen , Trang H. Tran , Huy Hieu Pham , Phi Le Nguyen , Lam M. Nguyen

Sequential recommendation aims to capture users' dynamic interest and predicts the next item of users' preference. Most sequential recommendation methods use a deep neural network as sequence encoder to generate user and item…

信息检索 · 计算机科学 2023-05-17 Hanwen Du , Huanhuan Yuan , Pengpeng Zhao , Fuzhen Zhuang , Guanfeng Liu , Lei Zhao , Victor S. Sheng

Spatio-temporal forecasting is essential for real-world applications such as traffic management and urban computing. Although recent methods have shown improved accuracy, they often fail to account for dynamic deviations between current…

机器学习 · 计算机科学 2025-10-07 Haotian Gao , Zheng Dong , Jiawei Yong , Shintaro Fukushima , Kenjiro Taura , Renhe Jiang

Given the abundance of unlabeled Satellite Image Time Series (SITS) and the scarcity of labeled data, contrastive self-supervised pretraining emerges as a natural tool to leverage this vast quantity of unlabeled data. However, designing…

计算机视觉与模式识别 · 计算机科学 2025-06-24 Antoine Saget , Baptiste Lafabregue , Antoine Cornuéjols , Pierre Gançarski

Contrastive learning has become pivotal in unsupervised representation learning, with frameworks like Momentum Contrast (MoCo) effectively utilizing large negative sample sets to extract discriminative features. However, traditional…

机器学习 · 计算机科学 2025-01-29 Duy Hoang , Huy Ngo , Khoi Pham , Tri Nguyen , Gia Bao , Huy Phan

Recently, there has been a significant advancement in designing Self-Supervised Learning (SSL) frameworks for time series data to reduce the dependency on data labels. Among these works, hierarchical contrastive learning-based SSL…

机器学习 · 计算机科学 2025-02-18 Kevin Garcia , Juan Manuel Perez , Yifeng Gao

Anomaly detection in multi-variate time series (MVTS) data is a huge challenge as it requires simultaneous representation of long term temporal dependencies and correlations across multiple variables. More often, this is solved by breaking…

机器学习 · 计算机科学 2022-02-09 Theivendiram Pranavan , Terence Sim , Arulmurugan Ambikapathi , Savitha Ramasamy

Self-supervised learning (SSL) has recently emerged as a powerful approach to learning representations from large-scale unlabeled data, showing promising results in time series analysis. The self-supervised representation learning can be…

机器学习 · 计算机科学 2024-03-18 Ziyu Liu , Azadeh Alavi , Minyi Li , Xiang Zhang

Temporal Graph Learning, which aims to model the time-evolving nature of graphs, has gained increasing attention and achieved remarkable performance recently. However, in reality, graph structures are often incomplete and noisy, which…

机器学习 · 计算机科学 2023-08-16 Haozhen Zhang , Xueting Han , Xi Xiao , Jing Bai

Biological brains learn continually from a stream of unlabeled data, while integrating specialized information from sparsely labeled examples without compromising their ability to generalize. Meanwhile, machine learning methods are…

机器学习 · 计算机科学 2026-01-27 Viet Anh Khoa Tran , Emre Neftci , Willem A. M. Wybo

Recently, learning effective representations of urban regions has gained significant attention as a key approach to understanding urban dynamics and advancing smarter cities. Existing approaches have demonstrated the potential of leveraging…

机器学习 · 计算机科学 2025-02-06 Namwoo Kim , Takahiro Yabe , Chanyoung Park , Yoonjin Yoon

Contrastive learning is a well-established paradigm in representation learning. The standard framework of contrastive learning minimizes the distance between "similar" instances and maximizes the distance between dissimilar ones in the…

机器学习 · 计算机科学 2025-02-06 Naghmeh Ghanooni , Barbod Pajoum , Harshit Rawal , Sophie Fellenz , Vo Nguyen Le Duy , Marius Kloft

Contrastive Learning (CL) performances as a rising approach to address the challenge of sparse and noisy recommendation data. Although having achieved promising results, most existing CL methods only perform either hand-crafted data or…

信息检索 · 计算机科学 2023-11-22 Xiuyuan Qin , Huanhuan Yuan , Pengpeng Zhao , Junhua Fang , Fuzhen Zhuang , Guanfeng Liu , Victor Sheng

Temporal Knowledge Graph (TKG) representation learning aims to map temporal evolving entities and relations to embedded representations in a continuous low-dimensional vector space. However, existing approaches cannot capture the temporal…

机器学习 · 计算机科学 2024-12-20 Qian Chen , Ling Chen

This paper presents SimCLR: a simple framework for contrastive learning of visual representations. We simplify recently proposed contrastive self-supervised learning algorithms without requiring specialized architectures or a memory bank.…

机器学习 · 计算机科学 2020-07-02 Ting Chen , Simon Kornblith , Mohammad Norouzi , Geoffrey Hinton

Contrastive learning (CL) has emerged as a promising approach for representation learning in time series data by embedding similar pairs closely while distancing dissimilar ones. However, existing CL methods often introduce false negative…

机器学习 · 计算机科学 2024-10-15 Yu Wu , Ting Dang , Dimitris Spathis , Hong Jia , Cecilia Mascolo

Trajectory similarity computation is fundamental functionality that is used for, e.g., clustering, prediction, and anomaly detection. However, existing learning-based methods exhibit three key limitations: (1) insufficient modeling of…

计算机视觉与模式识别 · 计算机科学 2025-12-18 Zhichen Lai , Hua Lu , Huan Li , Jialiang Li , Christian S. Jensen

Adapting Large Language Models (LLMs) that are extensively trained on abundant text data, and customizing the input prompt to enable time series forecasting has received considerable attention. While recent work has shown great potential…

机器学习 · 计算机科学 2024-12-09 Jayanie Bogahawatte , Sachith Seneviratne , Maneesha Perera , Saman Halgamuge

Recent breakthroughs in self-supervised learning show that such algorithms learn visual representations that can be transferred better to unseen tasks than joint-training methods relying on task-specific supervision. In this paper, we found…

机器学习 · 计算机科学 2021-06-29 Hyuntak Cha , Jaeho Lee , Jinwoo Shin

Time series classification (TSC) is an important task in time series analysis. Existing TSC methods mainly train on each single domain separately, suffering from a degradation in accuracy when the samples for training are insufficient in…

机器学习 · 计算机科学 2025-04-15 Yuxuan Chen , Shanshan Huang , Yunyao Cheng , Peng Chen , Zhongwen Rao , Yang Shu , Bin Yang , Lujia Pan , Chenjuan Guo