English
Related papers

Related papers: FormerTime: Hierarchical Multi-Scale Representatio…

200 papers

What sets timeseries analysis apart from other machine learning exercises is that time representation becomes a primary aspect of the experiment setup, as it must adequately represent the temporal relations that are relevant for the…

Machine Learning · Computer Science 2024-11-20 Natalia Koliou , Tatiana Boura , Stasinos Konstantopoulos , George Meramveliotakis , George Kosmadakis

In multivariable time series (MTS) forecasting, existing state-of-the-art deep learning approaches tend to focus on autoregressive formulations and often overlook the potential of using exogenous variables in enhancing the prediction of the…

Machine Learning · Computer Science 2025-04-03 Yuxuan Shu , Vasileios Lampos

The traditional Transformer model encounters challenges with variable-length input sequences, particularly in Hyperspectral Image Classification (HSIC), leading to efficiency and scalability concerns. To overcome this, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2024-09-20 Muhammad Ahmad , Muhammad Hassaan Farooq Butt , Manuel Mazzara , Salvatore Distifano

Deep learning methods are powerful tools in classifying multivariate time series data. Despite their high performance, these methods are hard to interpret, which diminishes their applications in high-risk domains such as healthcare. In this…

Machine Learning · Computer Science 2026-05-11 Bhavesh Kalisetti , Vincent Wang , Gaurav R. Ghosal , Maryam Bijanzadeh , Reza Abbasi-Asl

Transformer-based methods have achieved impressive results in time series forecasting. However, existing Transformers still exhibit limitations in sequence modeling as they tend to overemphasize temporal dependencies. This incurs additional…

Machine Learning · Computer Science 2025-12-16 Tan Wang , Yun Wei Dong , Qi Wang

Deep learning-based methods for Time Series Classification (TSC) typically utilize deep networks to extract features, which are then processed through a combination of a Fully Connected (FC) layer and a SoftMax function. However, we have…

Machine Learning · Computer Science 2024-07-23 Fan Zhao , You Chen

Time series classification (TSC) is the most import task in time series mining as it has several applications in medicine, meteorology, finance cyber security, and many others. With the ever increasing size of time series datasets, several…

Machine Learning · Computer Science 2023-12-12 Muhammad Marwan Muhammad Fuad

Multivariate time series classification is a task with increasing importance due to the proliferation of new problems in various fields (economy, health, energy, transport, crops, etc.) where a large number of information sources are…

Machine Learning · Computer Science 2020-09-09 Francisco J. Baldán , José M. Benítez

Time-series classification is one of the most frequently performed tasks in industrial data science, and one of the most widely used data representation in the industrial setting is tabular representation. In this work, we propose a novel…

Machine Learning · Computer Science 2021-10-06 Sharath M Shankaranarayana , Davor Runje

Generating a robust representation of the environment is a crucial ability of learning agents. Deep learning based methods have greatly improved perception systems but still fail in challenging situations. These failures are often not…

Computer Vision and Pattern Recognition · Computer Science 2018-10-16 Jörg Wagner , Volker Fischer , Michael Herman , Sven Behnke

Time series forecasting requires architectures that simultaneously achieve three competing objectives: (1) strict temporal causality for reliable predictions, (2) sub-quadratic complexity for practical scalability, and (3) multi-scale…

Machine Learning · Computer Science 2025-11-25 Qianru Zhang , Honggang Wen , Ming Li , Dong Huang , Siu-Ming Yiu , Christian S. Jensen , Pietro Liò

Multivariate time series classification (MTSC) plays a crucial role in various domains, including biomedical signal analysis and motion monitoring. However, existing approaches, particularly deep learning models, often require high…

Machine Learning · Computer Science 2026-04-20 Fernando Moro , Vinicius M. A. Souza

Multivariate Time Series (MTS) classification has gained importance over the past decade with the increase in the number of temporal datasets in multiple domains. The current state-of-the-art MTS classifier is a heavyweight deep learning…

Machine Learning · Computer Science 2021-12-10 Kevin Fauvel , Tao Lin , Véronique Masson , Élisa Fromont , Alexandre Termier

We study the use of a time series encoder to learn representations that are useful on data set types with which it has not been trained on. The encoder is formed of a convolutional neural network whose temporal output is summarized by a…

Machine Learning · Computer Science 2018-05-11 Joan Serrà , Santiago Pascual , Alexandros Karatzoglou

Nonlinear differential equations rarely admit closed-form solutions, thus requiring numerical time-stepping algorithms to approximate solutions. Further, many systems characterized by multiscale physics exhibit dynamics over a vast range of…

Machine Learning · Computer Science 2020-08-26 Yuying Liu , J. Nathan Kutz , Steven L. Brunton

Long-term time series forecasting (LTSF) has been widely applied in finance, traffic prediction, and other domains. Recently, patch-based transformers have emerged as a promising approach, segmenting data into sub-level patches that serve…

Machine Learning · Computer Science 2024-08-06 Ruixin Ding , Yuqi Chen , Yu-Ting Lan , Wei Zhang

Over the past decade, Time Series Classification (TSC) has gained an increasing attention. While various methods were explored, deep learning - particularly through Convolutional Neural Networks (CNNs)-stands out as an effective approach.…

Machine Learning · Computer Science 2024-02-29 Ali Ismail-Fawaz , Maxime Devanne , Stefano Berretti , Jonathan Weber , Germain Forestier

Demystifying interactions between temporal patterns of different scales is fundamental to precise long-range time series forecasting. However, previous works lack the ability to model high-order interactions. To promote more comprehensive…

Machine Learning · Computer Science 2024-12-24 Zongjiang Shang , Ling Chen , Binqing Wu , Dongliang Cui

In recent years, numerous Transformer-based models have been applied to long-term time-series forecasting (LTSF) tasks. However, recent studies with linear models have questioned their effectiveness, demonstrating that simple linear layers…

Machine Learning · Computer Science 2024-08-20 Jiaheng Yin , Zhengxin Shi , Jianshen Zhang , Xiaomin Lin , Yulin Huang , Yongzhi Qi , Wei Qi

Efficiently modeling spatio-temporal (ST) physical processes and observations presents a challenging problem for the deep learning community. Many recent studies have concentrated on meticulously reconciling various advantages, leading to…

Artificial Intelligence · Computer Science 2024-06-04 Hao Wu , Yuxuan Liang , Wei Xiong , Zhengyang Zhou , Wei Huang , Shilong Wang , Kun Wang