English
Related papers

Related papers: TS-Memory: Plug-and-Play Memory for Time Series Fo…

200 papers

Diffusion Language Models (DLMs) offer attractive advantages over Auto-Regressive (AR) models, such as full-attention parallel decoding and flexible generation. However, standard DLM training uses a static, single-step masked prediction…

Computation and Language · Computer Science 2026-04-14 Zehua Pei , Hui-Ling Zhen , Weizhe Lin , Sinno Jialin Pan , Yunhe Wang , Mingxuan Yuan , Bei Yu

Time series analysis is crucial for understanding dynamics of complex systems. Recent advances in foundation models have led to task-agnostic Time Series Foundation Models (TSFMs) and Large Language Model-based Time Series Models (TSLLMs),…

Machine Learning · Computer Science 2025-03-17 Xu Liu , Taha Aksu , Juncheng Liu , Qingsong Wen , Yuxuan Liang , Caiming Xiong , Silvio Savarese , Doyen Sahoo , Junnan Li , Chenghao Liu

Pruning can be an effective method of compressing large pre-trained models for inference speed acceleration. Previous pruning approaches rely on access to the original training dataset for both pruning and subsequent fine-tuning. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-11 Haihang Wu , Wei Wang , Tamasha Malepathirana , Sachith Seneviratne , Denny Oetomo , Saman Halgamuge

Data-driven thermal predictors for 3D-ICs are often trained from scratch for each chip design using many high-fidelity finite-element simulations, leading to high data-generation cost and costly cross-design reuse. We propose Therm-FM, a…

Computational Engineering, Finance, and Science · Computer Science 2026-05-26 Zhen Huang , Haiyang Xin , Wenkai Yang , Yangbo Wei , Zhiping Yu , Yu Zhang , Wei W. Xing , Ting-Jung Lin , Lei He

Leveraging Large Language Models (LLMs) as federated learning (FL)-based time series foundation models offers a promising way to transfer the generalization capabilities of LLMs to time series data while preserving access to private data.…

Machine Learning · Computer Science 2026-04-07 Liwei Deng , Qingxiang Liu , Xinhe Niu , Shengchao Chen , Sheng Sun , Yuankai Wu , Guodong Long , Yuxuan Liang

This paper presents a simple yet effective approach that improves continual test-time adaptation (TTA) in a memory-efficient manner. TTA may primarily be conducted on edge devices with limited memory, so reducing memory is crucial but has…

Computer Vision and Pattern Recognition · Computer Science 2023-05-24 Junha Song , Jungsoo Lee , In So Kweon , Sungha Choi

Large Language Models (LLMs) have demonstrated effectiveness as zero-shot time series (TS) forecasters. The key challenge lies in tokenizing TS data into textual representations that align with LLMs' pre-trained knowledge. While existing…

Artificial Intelligence · Computer Science 2025-12-24 Xingyou Yin , Ceyao Zhang , Min Hu , Kai Chen

Short-term load forecasting (STLF) is challenging due to complex time series (TS) which express three seasonal patterns and a nonlinear trend. This paper proposes a novel hybrid hierarchical deep learning model that deals with multiple…

Machine Learning · Computer Science 2021-12-07 Slawek Smyl , Grzegorz Dudek , Paweł Pełka

Multi-task and few-shot time series forecasting tasks are commonly encountered in scenarios such as the launch of new products in different cities. However, traditional time series forecasting methods suffer from insufficient historical…

Machine Learning · Computer Science 2025-06-25 Pengpeng Ouyang , Dong Chen , Tong Yang , Shuo Feng , Zhao Jin , Mingliang Xu

The proliferation of Time Series Foundation Models (TSFMs) has significantly advanced zero-shot forecasting, enabling predictions for unseen time series without task-specific fine-tuning. Extensive research has confirmed that no single TSFM…

Machine Learning · Computer Science 2025-09-26 Hao-Nan Shi , Ting-Ji Huang , Lu Han , De-Chuan Zhan , Han-Jia Ye

Streamflow forecasting is key to effectively managing water resources and preparing for the occurrence of natural calamities being exacerbated by climate change. Here we use the concept of fast and slow flow components to create a new…

Machine Learning · Computer Science 2021-07-14 Miguel Paredes Quiñones , Maciel Zortea , Leonardo S. A. Martins

The identification of sensory cues associated with potential opportunities and dangers is frequently complicated by unrelated events that separate useful cues by long delays. As a result, it remains a challenging task for state-of-the-art…

Neural and Evolutionary Computing · Computer Science 2023-07-17 Shimin Zhang , Qu Yang , Chenxiang Ma , Jibin Wu , Haizhou Li , Kay Chen Tan

Spatio-temporal forecasting plays a crucial role in various sectors such as transportation systems, logistics, and supply chain management. However, existing methods are limited by their ability to handle large, complex datasets. To…

Machine Learning · Computer Science 2024-08-27 Sakhinana Sagar Srinivas , Chidaksh Ravuru , Geethan Sannidhi , Venkataramana Runkana

Recent developments related to the energy transition pose particular challenges for distribution grids. Hence, precise load forecasts become more and more important for effective grid management. Novel modeling approaches such as the…

Machine Learning · Computer Science 2023-05-19 Elena Giacomazzi , Felix Haag , Konstantin Hopf

The increasing need for compact and low-power computing solutions for machine learning applications has triggered significant interest in energy-efficient neuromorphic systems. However, most of these architectures rely on spiking neural…

Neural and Evolutionary Computing · Computer Science 2019-12-23 Manu V Nair , Giacomo Indiveri

Modern IoT deployments for environmental sensing produce high volume spatiotemporal data to support downstream tasks such as forecasting, typically powered by machine learning models. While existing filtering and strategic deployment…

Machine Learning · Computer Science 2025-12-02 Ragini Gupta , Naman Raina , Bo Chen , Li Chen , Claudiu Danilov , Josh Eckhardt , Keyshla Bernard , Klara Nahrstedt

Behavioral Foundation Models (BFMs) proved successful in producing policies for arbitrary tasks in a zero-shot manner, requiring no test-time training or task-specific fine-tuning. Among the most promising BFMs are the ones that estimate…

Machine Learning · Computer Science 2026-05-05 Maksim Bobrin , Ilya Zisman , Alexander Nikulin , Vladislav Kurenkov , Dmitry Dylov

Regional rainfall-runoff modeling is an old but still mostly out-standing problem in Hydrological Sciences. The problem currently is that traditional hydrological models degrade significantly in performance when calibrated for multiple…

Machine Learning · Computer Science 2019-11-12 Frederik Kratzert , Daniel Klotz , Guy Shalev , Günter Klambauer , Sepp Hochreiter , Grey Nearing

Time-series forecasting (TSF) finds broad applications in real-world scenarios. Due to the dynamic nature of time-series data, it is crucial to equip TSF models with out-of-distribution (OOD) generalization abilities, as historical training…

Machine Learning · Computer Science 2024-06-14 Haoxin Liu , Harshavardhan Kamarthi , Lingkai Kong , Zhiyuan Zhao , Chao Zhang , B. Aditya Prakash

In recent years, numerous real-time stereo matching methods have been introduced, but they often lack accuracy. These methods attempt to improve accuracy by introducing new modules or integrating traditional methods. However, the…

Computer Vision and Pattern Recognition · Computer Science 2024-05-22 Baiyu Pan , Jichao Jiao , Jianxing Pang , Jun Cheng