English
Related papers

Related papers: Time-Transformer: Integrating Local and Global Fea…

200 papers

Although recent generative models can produce time series with close marginal distributions, they often face a fundamental tension between preserving global temporal structure and modeling stochastic local variations, particularly for…

Machine Learning · Computer Science 2026-03-23 Shaoshuai Du , Joze M. Rozanec , Andy Pimentel , Ana-Lucia Varbanescu

Although transformer-based methods have achieved great success in multi-scale temporal pattern interaction modeling, two key challenges limit their further development: (1) Individual time points contain less semantic information, and…

Machine Learning · Computer Science 2024-11-01 Zongjiang Shang , Ling Chen , Binqing wu , Dongliang Cui

Tabular data remains a challenging domain for generative models. In particular, the standard Variational Autoencoder (VAE) architecture, typically composed of multilayer perceptrons, struggles to model relationships between features,…

Machine Learning · Computer Science 2026-01-29 Aníbal Silva , Moisés Santos , André Restivo , Carlos Soares

Despite recent progress in time-series foundation models, challenges persist in improving representation learning and adapting to diverse downstream tasks. We introduce a General Time-series Model (GTM), which advances representation…

Machine Learning · Computer Science 2026-03-13 Cheng He , Xu Huang , Gangwei Jiang , Zhaoyi Li , Defu Lian , Hong Xie , Enhong Chen , Xijie Liang , Zengrong Zheng , Patrick P. C. Lee

Time-series forecasts are essential for planning and decision-making in many domains. Explainability is key to building user trust and meeting transparency requirements. Shapley Additive Explanations (SHAP) is a popular explainable AI…

Machine Learning · Computer Science 2025-12-24 Matthias Hertel , Sebastian Pütz , Ralf Mikut , Veit Hagenmeyer , Benjamin Schäfer

Many of today's data is time-series data originating from various sources, such as sensors, transaction systems, or production systems. Major challenges with such data include privacy and business sensitivity. Generative time-series models…

Machine Learning · Computer Science 2024-06-19 David Bergström , Mattias Tiger , Fredrik Heintz

Temporal non-stationarity, the phenomenon that time series distributions change over time, poses fundamental challenges to reliable time series forecasting. Intuitively, the complex time series can be decomposed into two factors, \ie…

Machine Learning · Computer Science 2025-10-21 Mingyuan Xia , Chunxu Zhang , Zijian Zhang , Hao Miao , Qidong Liu , Yuanshao Zhu , Bo Yang

While anomaly detection in time series has been an active area of research for several years, most recent approaches employ an inadequate evaluation criterion leading to an inflated F1 score. We show that a rudimentary Random Guess method…

Machine Learning · Computer Science 2022-03-11 Keval Doshi , Shatha Abudalou , Yasin Yilmaz

Transformer based knowledge tracing model is an extensively studied problem in the field of computer-aided education. By integrating temporal features into the encoder-decoder structure, transformers can processes the exercise information…

Artificial Intelligence · Computer Science 2021-02-02 Chengwei Zhang , Yangzhou Jiang , Wei Zhang , Chengyu Gu

Transformer-based foundation models have emerged as a dominant paradigm in time series analysis, offering unprecedented capabilities in tasks such as forecasting, anomaly detection, classification, trend analysis and many more time series…

Generative Adversarial Networks (GANs) have been used in many different applications to generate realistic synthetic data. We introduce a novel GAN with Autoencoder (GAN-AE) architecture to generate synthetic samples for variable length,…

Machine Learning · Computer Science 2022-10-10 Stephanie Ger , Yegna Subramanian Jambunath , Diego Klabjan

High-resolution time series data are crucial for the operation and planning of energy systems such as electrical power systems and heating systems. Such data often cannot be shared due to privacy concerns, necessitating the use of synthetic…

Machine Learning · Computer Science 2025-06-19 Nan Lin , Peter Palensky , Pedro P. Vergara

The unprecedented availability of spatial and temporal high-resolution satellite image time series (SITS) for crop type mapping is believed to necessitate deep learning architectures to accommodate challenges arising from both dimensions.…

Computer Vision and Pattern Recognition · Computer Science 2022-03-31 Xin Cai , Yaxin Bi , Peter Nicholl

Recently, molecule generation using deep learning has been actively investigated in drug discovery. In this field, Transformer and VAE are widely used as powerful models, but they are rarely used in combination due to structural and…

Biomolecules · Quantitative Biology 2024-04-08 Yasuhiro Yoshikai , Tadahaya Mizuno , Shumpei Nemoto , Hiroyuki Kusuhara

Along with AIGC shines in CV and NLP, its potential in the wireless domain has also emerged in recent years. Yet, existing RF-oriented generative solutions are ill-suited for generating high-quality, time-series RF data due to limited…

Machine Learning · Computer Science 2024-04-16 Guoxuan Chi , Zheng Yang , Chenshu Wu , Jingao Xu , Yuchong Gao , Yunhao Liu , Tony Xiao Han

Temporal convolutions have been the paradigm of choice in action segmentation, which enhances long-term receptive fields by increasing convolution layers. However, high layers cause the loss of local information necessary for frame…

Computer Vision and Pattern Recognition · Computer Science 2022-05-20 Jiahui Wang , Zhenyou Wang , Shanna Zhuang , Hui Wang

Time series analysis finds wide applications in fields such as weather forecasting, anomaly detection, and behavior recognition. Previous methods attempted to model temporal variations directly using 1D time series. However, this has been…

Machine Learning · Computer Science 2024-11-08 Qiang Wu , Gechang Yao , Zhixi Feng , Shuyuan Yang

In many real-world application, e.g., speech recognition or sleep stage classification, data are captured over the course of time, constituting a Time-Series. Time-Series often contain temporal dependencies that cause two otherwise…

Machine Learning · Computer Science 2017-01-10 John Cristian Borges Gamboa

In this paper, we aim to improve multivariate anomaly detection (AD) by modeling the \textit{time-varying non-linear spatio-temporal correlations} found in multivariate time series data . In multivariate time series data, an anomaly may be…

Machine Learning · Computer Science 2025-09-19 Padmaksha Roy , Almuatazbellah Boker , Lamine Mili

Time series data are often obtained only within a limited time range due to interruptions during observation process. To classify such partial time series, we need to account for 1) the variable-length data drawn from 2) different…

Machine Learning · Computer Science 2022-07-14 Azusa Sawada , Taiki Miyagawa , Akinori F. Ebihara , Shoji Yachida , Toshinori Hosoi