English
Related papers

Related papers: Unsupervised Time-Series Representation Learning w…

200 papers

Multivariate time series present challenges to standard machine learning techniques, as they are often unlabeled, high dimensional, noisy, and contain missing data. To address this, we propose T-Rep, a self-supervised method to learn time…

Machine Learning · Computer Science 2024-05-10 Archibald Fraikin , Adrien Bennetot , Stéphanie Allassonnière

Transformer-based models are at the forefront in long time-series forecasting (LTSF). While in many cases, these models are able to achieve state of the art results, they suffer from a bias toward low-frequencies in the data and high…

Machine Learning · Computer Science 2026-05-13 Elisha Dayag , Nhat Thanh Van Tran , Jack Xin

While unsupervised change detection using contrastive learning has been significantly improved the performance of literature techniques, at present, it only focuses on the bi-temporal change detection scenario. Previous state-of-the-art…

Computer Vision and Pattern Recognition · Computer Science 2023-04-25 Yuxing Chen , Lorenzo Bruzzone

Unlike other vision tasks where Transformer-based approaches are becoming increasingly common, stereo depth estimation is still dominated by convolution-based approaches. This is mainly due to the limited availability of real-world ground…

Computer Vision and Pattern Recognition · Computer Science 2024-09-05 Soomin Kim , Hyesong Choi , Jihye Ahn , Dongbo Min

Contrastive learning of auditory and visual perception has been extremely successful when investigated individually. However, there are still major questions on how we could integrate principles learned from both domains to attain effective…

Computer Vision and Pattern Recognition · Computer Science 2021-10-15 Haider Al-Tahan , Yalda Mohsenzadeh

In recent years, both online and offline deep learning models have been developed for time series forecasting. However, offline deep forecasting models fail to adapt effectively to changes in time-series data, while online deep forecasting…

Machine Learning · Computer Science 2024-02-06 Mohamed Mejri , Chandramouli Amarnath , Abhijit Chatterjee

Currently, iTransformer is one of the most popular and effective models for multivariate time series (MTS) forecasting. Thanks to its inverted framework, iTransformer effectively captures multivariate correlation. However, the inverted…

Machine Learning · Computer Science 2025-07-17 Hongming Tan , Ting Chen , Ruochong Jin , Wai Kin Chan

Latent representations are critical for the performance and robustness of machine learning models, as they encode the essential features of data in a compact and informative manner. However, in vision tasks, these representations are often…

Machine Learning · Computer Science 2025-10-03 Bruno Corcuera , Carlos Eiras-Franco , Brais Cancela

Despite the eminent successes of deep neural networks, many architectures are often hard to transfer to irregularly-sampled and asynchronous time series that commonly occur in real-world datasets, especially in healthcare applications. This…

Machine Learning · Computer Science 2020-09-16 Max Horn , Michael Moor , Christian Bock , Bastian Rieck , Karsten Borgwardt

Recently, there has been a significant advancement in designing Self-Supervised Learning (SSL) frameworks for time series data to reduce the dependency on data labels. Among these works, hierarchical contrastive learning-based SSL…

Machine Learning · Computer Science 2025-02-18 Kevin Garcia , Juan Manuel Perez , Yifeng Gao

In this paper, we present an Adaptive Ensemble Learning framework that aims to boost the performance of deep neural networks by intelligently fusing features through ensemble learning techniques. The proposed framework integrates ensemble…

Artificial Intelligence · Computer Science 2023-04-07 Neelesh Mungoli

Inspired by recent successes of deep learning in computer vision, we propose a novel framework for encoding time series as different types of images, namely, Gramian Angular Summation/Difference Fields (GASF/GADF) and Markov Transition…

Machine Learning · Computer Science 2015-06-02 Zhiguang Wang , Tim Oates

(Very early draft)Traditional supervised learning keeps pushing convolution neural network(CNN) achieving state-of-art performance. However, lack of large-scale annotation data is always a big problem due to the high cost of it, even…

Computer Vision and Pattern Recognition · Computer Science 2019-11-26 Zhibo Wang , Shen Yan , Xiaoyu Zhang , Niels Lobo

In time series classification and regression, signals are typically mapped into some intermediate representation used for constructing models. Since the underlying task is often insensitive to time shifts, these representations are required…

Sound · Computer Science 2019-07-16 Joakim Andén , Vincent Lostanlen , Stéphane Mallat

We present a representation learning framework for financial time series forecasting. One challenge of using deep learning models for finance forecasting is the shortage of available training data when using small datasets. Direct trend…

Machine Learning · Computer Science 2021-05-10 Hanwei Wu , Ather Gattami , Markus Flierl

Selecting an appropriate look-back horizon remains a fundamental challenge in time series forecasting (TSF), particularly in the federated learning scenarios where data is decentralized, heterogeneous, and often non-independent. While…

Machine Learning · Computer Science 2026-01-06 Dahao Tang , Nan Yang , Yanli Li , Zhiyu Zhu , Zhibo Jin , Dong Yuan

Recent advancements in long-term time series forecasting (LTSF) have primarily focused on capturing cross-time and cross-variate (channel) dependencies within historical data. However, a critical aspect often overlooked by many existing…

Machine Learning · Computer Science 2024-12-03 Chaolv Zeng , Yuan Tian , Guanjie Zheng , Yunjun Gao

Irregular sampling occurs in many time series modeling applications where it presents a significant challenge to standard deep learning models. This work is motivated by the analysis of physiological time series data in electronic health…

Machine Learning · Computer Science 2021-06-08 Satya Narayan Shukla , Benjamin M. Marlin

Multivariate long-term time series forecasting has been suffering from the challenge of capturing both temporal dependencies within variables and spatial correlations across variables simultaneously. Current approaches predominantly…

Machine Learning · Computer Science 2025-09-15 Chenheng Xu , Dan Wu , Yixin Zhu , Ying Nian Wu

Self-supervised learning is a promising unsupervised learning framework that has achieved success with large floating point networks. But such networks are not readily deployable to edge devices. To accelerate deployment of models with the…

Machine Learning · Computer Science 2022-03-30 Dahyun Kim , Jonghyun Choi