English
Related papers

Related papers: Dish-TS: A General Paradigm for Alleviating Distri…

200 papers

Time series segmentation (TSS) is one of the time series (TS) analysis techniques, that has received considerably less attention compared to other TS related tasks. In recent years, deep learning architectures have been introduced for TSS,…

Machine Learning · Computer Science 2026-02-20 Ivana Kesić , Carolina Fortuna , Mihael Mohorčič , Blaž Bertalanič

The attention mechanism has demonstrated remarkable potential in sequence modeling, exemplified by its successful application in natural language processing with models such as Bidirectional Encoder Representations from Transformers (BERT)…

Machine Learning · Computer Science 2025-11-26 Bowen Zhao , Huanlai Xing , Zhiwen Xiao , Jincheng Peng , Li Feng , Xinhan Wang , Rong Qu , Hui Li

Time-series forecasting often faces challenges from non-stationarity, particularly distributional drift, where the data distribution evolves over time. This dynamic behavior can undermine the effectiveness of adaptive optimizers, such as…

Machine Learning · Computer Science 2026-03-12 Yuze Dong , Jinsong Wu

Despite the notable advancements in numerous Transformer-based models, the task of long multi-horizon time series forecasting remains a persistent challenge, especially towards explainability. Focusing on commonly used saliency maps in…

Machine Learning · Computer Science 2023-09-18 Nghia Duong-Trung , Duc-Manh Nguyen , Danh Le-Phuoc

Research on long-term time series prediction has primarily relied on Transformer and MLP models, while the potential of convolutional networks in this domain remains underexplored. To address this, we propose a novel multi-scale time series…

Machine Learning · Computer Science 2025-10-03 Chenghan Li , Mingchen Li , Yipu Liao , Ruisheng Diao

Standard deep learning models such as convolutional neural networks (CNNs) lack the ability of generalizing to domains which have not been seen during training. This problem is mainly due to the common but often wrong assumption of such…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Mehrdad Noori , Milad Cheraghalikhani , Ali Bahri , Gustavo A. Vargas Hakim , David Osowiechi , Ismail Ben Ayed , Christian Desrosiers

Feature engineering is required to obtain better results for time series forecasting, and decomposition is a crucial one. One decomposition approach often cannot be used for numerous forecasting tasks since the standard time series…

Machine Learning · Computer Science 2022-10-10 Liwang Zhou , Jing Gao

The fast adaptation capability of deep neural networks in non-stationary environments is critical for online time series forecasting. Successful solutions require handling changes to new and recurring patterns. However, training deep neural…

Machine Learning · Computer Science 2022-10-18 Quang Pham , Chenghao Liu , Doyen Sahoo , Steven C. H. Hoi

Time Series Forecasting (TSF) is used to predict the target variables at a future time point based on the learning from previous time points. To keep the problem tractable, learning methods use data from a fixed length window in the past as…

Machine Learning · Computer Science 2022-04-26 Jimeng Shi , Mahek Jain , Giri Narasimhan

Time series forecasting, which aims to predict future values based on historical data, has garnered significant attention due to its broad range of applications. However, real-world time series often exhibit complex non-uniform distribution…

Machine Learning · Computer Science 2025-10-02 Yanru Sun , Zongxia Xie , Emadeldeen Eldele , Dongyue Chen , Qinghua Hu , Min Wu

Vision Transformers (ViTs) have achieved impressive performance on various vision tasks, yet their generalization under distribution shifts (DS) is rarely understood. In this work, we comprehensively study the out-of-distribution (OOD)…

Computer Vision and Pattern Recognition · Computer Science 2022-03-09 Chongzhi Zhang , Mingyuan Zhang , Shanghang Zhang , Daisheng Jin , Qiang Zhou , Zhongang Cai , Haiyu Zhao , Xianglong Liu , Ziwei Liu

Time-series forecasting is a critical challenge in various domains and has witnessed substantial progress in recent years. Many real-life scenarios, such as public health, economics, and social applications, involve feedback loops where…

Machine Learning · Computer Science 2025-06-04 Zhiyuan Zhao , Haoxin Liu , Alexander Rodriguez , B. Aditya Prakash

While generative modeling on time series facilitates more capable and flexible probabilistic forecasting, existing generative time series models do not address the multi-dimensional properties of time series data well. The prevalent…

Machine Learning · Computer Science 2026-02-09 Haoran Zhang , Haixuan Liu , Yong Liu , Yunzhong Qiu , Yuxuan Wang , Jianmin Wang , Mingsheng Long

New remote sensing sensors now acquire high spatial and spectral Satellite Image Time Series (SITS) of the world. These series of images are a key component of classification systems that aim at obtaining up-to-date and accurate land cover…

Computer Vision and Pattern Recognition · Computer Science 2019-02-01 Charlotte Pelletier , Geoffrey I. Webb , Francois Petitjean

Multivariate geo-sensory time series prediction is challenging because of the complex spatial and temporal correlation. In urban water distribution systems (WDS), numerous spatial-correlated sensors have been deployed to continuously…

Machine Learning · Computer Science 2020-04-15 Ziqing Ma , Shuming Liu , Guancheng Guo , Xipeng Yu

Foundation models have emerged as a promising approach in time series forecasting (TSF). Existing approaches either repurpose large language models (LLMs) or build large-scale time series datasets to develop TSF foundation models for…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Mouxiang Chen , Lefei Shen , Zhuo Li , Xiaoyun Joy Wang , Jianling Sun , Chenghao Liu

Deep learning has achieved strong performance in Time Series Forecasting (TSF). However, we identify a critical representation paradox, termed Latent Chaos: models with accurate predictions often learn latent representations that are…

Machine Learning · Computer Science 2026-05-13 Jie Yang , Yifan Hu , Yuante Li , Kexin Zhang , Kaize Ding , Philip S. Yu

Selecting an appropriate look-back horizon remains a fundamental challenge in time series forecasting (TSF), particularly in the federated learning scenarios where data is decentralized, heterogeneous, and often non-independent. While…

Machine Learning · Computer Science 2026-01-06 Dahao Tang , Nan Yang , Yanli Li , Zhiyu Zhu , Zhibo Jin , Dong Yuan

Temporal distribution shift (TDS) erodes the long-term accuracy of recommender systems, yet industrial practice still relies on periodic incremental training, which struggles to capture both stable and transient patterns. Existing…

Machine Learning · Computer Science 2025-11-27 Yuxuan Zhu , Cong Fu , Yabo Ni , Anxiang Zeng , Yuan Fang

We study a setting where the goal is to learn a target function f(x) with respect to a target distribution D(x), but training is done on i.i.d. samples from a different training distribution D'(x), labeled by the true target f(x). Such a…

Machine Learning · Computer Science 2026-02-13 Marko Medvedev , Idan Attias , Elisabetta Cornacchia , Theodor Misiakiewicz , Gal Vardi , Nathan Srebro