English
Related papers

Related papers: Universal Time-Series Representation Learning: A S…

200 papers

Multivariate Time Series Forecasting (MTSF) plays a crucial role across diverse fields, ranging from economic, energy, to traffic. In recent years, deep learning has demonstrated outstanding performance in MTSF tasks. In MTSF, modeling the…

Machine Learning · Computer Science 2026-01-28 Xiangfei Qiu , Hanyin Cheng , Xingjian Wu , Junkai Lu , Jilin Hu , Chenjuan Guo , Christian S. Jensen , Bin Yang

This paper presents a method for time series forecasting with deep learning and its assessment on two datasets. The method starts with data preparation, followed by model training and evaluation. The final step is a visual inspection.…

Machine Learning · Computer Science 2023-02-24 Gissel Velarde

Identifying the extent to which every temporal segment influences a model's predictions is essential for explaining model decisions and increasing transparency. While post-hoc explainable methods based on gradients and feature-based…

Machine Learning · Computer Science 2026-03-10 Akash Pandey , Payal Mohapatra , Wei Chen , Qi Zhu , Sinan Keten

Deep learning methods are powerful tools in classifying multivariate time series data. Despite their high performance, these methods are hard to interpret, which diminishes their applications in high-risk domains such as healthcare. In this…

Machine Learning · Computer Science 2026-05-11 Bhavesh Kalisetti , Vincent Wang , Gaurav R. Ghosal , Maryam Bijanzadeh , Reza Abbasi-Asl

A representation is supposed universal if it encodes any element of the visual world (e.g., objects, scenes) in any configuration (e.g., scale, context). While not expecting pure universal representations, the goal in the literature is to…

Computer Vision and Pattern Recognition · Computer Science 2018-09-05 Youssef Tamaazousti , Hervé Le Borgne , Céline Hudelot , Mohamed El Amine Seddik , Mohamed Tamaazousti

Three important properties of a classification machinery are: (i) the system preserves the core information of the input data; (ii) the training examples convey information about unseen data; and (iii) the system is able to treat…

Neural and Evolutionary Computing · Computer Science 2016-06-29 Raja Giryes , Guillermo Sapiro , Alex M. Bronstein

Disentangled representation learning offers useful properties such as dimension reduction and interpretability, which are essential to modern deep learning approaches. Although deep learning techniques have been widely applied to…

Machine Learning · Computer Science 2022-04-11 Sichen Zhao , Wei Shao , Jeffrey Chan , Flora D. Salim

Deep learning time-series models are often used to make forecasts that inform downstream decisions. Since these decisions can differ from those in the training set, there is an implicit requirement that time-series models will generalize…

Machine Learning · Computer Science 2024-11-04 Thomas Crasson , Yacine Nabet , Mathias Lécuyer

Deep learning is currently the subject of intensive study. However, fundamental concepts such as representations are not formally defined -- researchers "know them when they see them" -- and there is no common language for describing and…

Machine Learning · Computer Science 2015-09-30 David Balduzzi

The classification of time-series data is pivotal for streaming data and comes with many challenges. Although the amount of publicly available datasets increases rapidly, deep neural models are only exploited in a few areas. Traditional…

Machine Learning · Computer Science 2021-09-27 Dominique Mercier , Andreas Dengel , Sheraz Ahmed

Neural networks leverage robust internal representations in order to generalise. Learning them is difficult, and often requires a large training set that covers the data distribution densely. We study a common setting where our task is not…

Time series are often complex and rich in information but sparsely labeled and therefore challenging to model. In this paper, we propose a self-supervised framework for learning generalizable representations for non-stationary time series.…

Machine Learning · Computer Science 2021-06-03 Sana Tonekaboni , Danny Eytan , Anna Goldenberg

The ability to predict, anticipate and reason about future outcomes is a key component of intelligent decision-making systems. In light of the success of deep learning in computer vision, deep-learning-based video prediction emerged as a…

Irregular sampling occurs in many time series modeling applications where it presents a significant challenge to standard deep learning models. This work is motivated by the analysis of physiological time series data in electronic health…

Machine Learning · Computer Science 2021-06-08 Satya Narayan Shukla , Benjamin M. Marlin

In this paper, we investigate how to learn a suitable representation of satellite image time series in an unsupervised manner by leveraging large amounts of unlabeled data. Additionally , we aim to disentangle the representation of time…

Computer Vision and Pattern Recognition · Computer Science 2019-03-22 Eduardo Sanchez , Mathieu Serrurier , Mathias Ortner

Machine learning and in particular deep learning algorithms are the emerging approaches to data analysis. These techniques have transformed traditional data mining-based analysis radically into a learning-based model in which existing data…

Machine Learning · Computer Science 2020-04-17 Neda Tavakoli , Sima Siami-Namini , Mahdi Adl Khanghah , Fahimeh Mirza Soltani , Akbar Siami Namin

Representation learning is the foundation for the recent success of neural network models. However, the distributed representations generated by neural networks are far from ideal. Due to their highly entangled nature, they are di cult to…

Machine Learning · Computer Science 2016-02-09 William Whitney

Machine learning approaches to spatiotemporal physical systems have primarily focused on next-frame prediction, with the goal of learning an accurate emulator for the system's evolution in time. However, these emulators are computationally…

Machine Learning · Computer Science 2026-03-16 Helen Qu , Rudy Morel , Michael McCabe , Alberto Bietti , François Lanusse , Shirley Ho , Yann LeCun

Social network analysis is an important problem in data mining. A fundamental step for analyzing social networks is to encode network data into low-dimensional representations, i.e., network embeddings, so that the network topology…

Social and Information Networks · Computer Science 2019-04-19 Qiaoyu Tan , Ninghao Liu , Xia Hu

Time series analysis remains a major challenge due to its sparse characteristics, high dimensionality, and inconsistent data quality. Recent advancements in transformer-based techniques have enhanced capabilities in forecasting and…

Machine Learning · Computer Science 2024-05-29 Robert Leppich , Vanessa Borst , Veronika Lesch , Samuel Kounev