中文
相关论文

相关论文: Improving Time Series Encoding with Noise-Aware Se…

200 篇论文

Detecting critical transitions in complex, noisy time-series data is a fundamental challenge across science and engineering. Such transitions may be anticipated by the emergence of a low-dimensional order parameter, whose signature is often…

机器学习 · 计算机科学 2025-12-16 Wenqi Fang , Ye Li

Contrastive learning has become pivotal in unsupervised representation learning, with frameworks like Momentum Contrast (MoCo) effectively utilizing large negative sample sets to extract discriminative features. However, traditional…

机器学习 · 计算机科学 2025-01-29 Duy Hoang , Huy Ngo , Khoi Pham , Tri Nguyen , Gia Bao , Huy Phan

The surge in the significance of time series in digital health domains necessitates advanced methodologies for extracting meaningful patterns and representations. Self-supervised contrastive learning has emerged as a promising approach for…

机器学习 · 计算机科学 2025-09-25 Kevin Garcia , Cassandra Garza , Brooklyn Berry , Yifeng Gao

In this paper, we propose a novel self-supervised representation learning by taking advantage of a neighborhood-relational encoding (NRE) among the training data. Conventional unsupervised learning methods only focused on training deep…

计算机视觉与模式识别 · 计算机科学 2019-08-29 Mohammad Sabokrou , Mohammad Khalooei , Ehsan Adeli

Unsupervised learning methods for feature extraction are becoming more and more popular. We combine the popular contrastive learning method (prototypical contrastive learning) and the classic representation learning method (autoencoder) to…

计算机视觉与模式识别 · 计算机科学 2022-05-11 Zeyu Cao , Xiaorun Li , Liaoying Zhao

Recently, self-supervised representation learning gives further development in multimedia technology. Most existing self-supervised learning methods are applicable to packaged data. However, when it comes to streamed data, they are…

计算机视觉与模式识别 · 计算机科学 2022-11-03 Zhiwei Lin , Yongtao Wang , Hongxiang Lin

In recent years, the introduction of self-supervised contrastive learning (SSCL) has demonstrated remarkable improvements in representation learning across various domains, including natural language processing and computer vision. By…

机器学习 · 计算机科学 2023-08-15 Chiyu Zhang , Qi Yan , Lili Meng , Tristan Sylvain

Recently, various contrastive learning techniques have been developed to categorize time series data and exhibit promising performance. A general paradigm is to utilize appropriate augmentations and construct feasible positive samples such…

机器学习 · 计算机科学 2024-10-11 Qianying Ren , Dongsheng Luo , Dongjin Song

In machine learning, effective modeling requires a holistic consideration of how to encode inputs, make predictions (i.e., decoding), and train the model. However, in time-series forecasting, prior work has predominantly focused on encoder…

机器学习 · 计算机科学 2025-12-30 Jaebin Lee , Hankook Lee

Contrastive approaches to representation learning have recently shown great promise. In contrast to generative approaches, these contrastive models learn a deterministic encoder with no notion of uncertainty or confidence. In this paper, we…

机器学习 · 计算机科学 2020-10-06 Mike Wu , Noah Goodman

Self-supervised learning (SSL) has grown in interest within the speech processing community, since it produces representations that are useful for many downstream tasks. SSL uses global and contextual methods to produce robust…

音频与语音处理 · 电气工程与系统科学 2024-11-08 Subrina Sultana , Donald S. Williamson

Finding effective representations for time series data is a useful but challenging task. Several works utilize self-supervised or unsupervised learning methods to address this. However, there still remains the open question of how to…

机器学习 · 计算机科学 2024-03-19 Yuansan Liu , Sudanthi Wijewickrema , Christofer Bester , Stephen O'Leary , James Bailey

Self-supervised representation learning of Multivariate Time Series (MTS) is a challenging task and attracts increasing research interests in recent years. Many previous works focus on the pretext task of self-supervised learning and…

机器学习 · 计算机科学 2022-03-10 Yijiang Chen , Xiangdong Zhou , Zhen Xing , Zhidan Liu , Minyang Xu

As the digital landscape becomes more interconnected, the frequency and severity of zero-day attacks, have significantly increased, leading to an urgent need for innovative Intrusion Detection Systems (IDS). Machine Learning-based IDS that…

密码学与安全 · 计算机科学 2025-05-15 Ippokratis Koukoulis , Ilias Syrigos , Thanasis Korakis

Self-supervised learning can significantly improve the performance of downstream tasks, however, the dimensions of learned representations normally lack explicit physical meanings. In this work, we propose a novel self-supervised approach…

音频与语音处理 · 电气工程与系统科学 2022-01-19 Yifan Sun , Xihong Wu

Contrastive representation learning is crucial in time series analysis as it alleviates the issue of data noise and incompleteness as well as sparsity of supervision signal. However, existing constrastive learning frameworks usually focus…

机器学习 · 计算机科学 2024-06-26 Haozhi Gao , Qianqian Ren , Jinbao Li

Self-supervised contrastive learning is an effective approach for addressing the challenge of limited labelled data. This study builds upon the previously established two-stage patch-level, multi-label classification method for…

计算机视觉与模式识别 · 计算机科学 2026-02-09 Salma Haidar , José Oramas

We propose a self-supervised method to learn feature representations from videos. A standard approach in traditional self-supervised methods uses positive-negative data pairs to train with contrastive learning strategy. In such a case,…

计算机视觉与模式识别 · 计算机科学 2020-08-13 Li Tao , Xueting Wang , Toshihiko Yamasaki

A new Lossy Causal Temporal Convolutional Neural Network Autoencoder for anomaly detection is proposed in this work. Our framework uses a rate-distortion loss and an entropy bottleneck to learn a compressed latent representation for the…

机器学习 · 计算机科学 2022-12-06 Christopher P. Ley , Jorge F. Silva

As an exemplary self-supervised approach for representation learning, time-series contrastive learning has exhibited remarkable advancements in contemporary research. While recent contrastive learning strategies have focused on how to…

机器学习 · 计算机科学 2024-08-27 Xiyuan Jin , Jing Wang , Lei Liu , Youfang Lin