English
Related papers

Related papers: Falcon-X: A Time Series Foundation Model for Heter…

200 papers

Federated fine-tuning of pre-trained Large Language Models (LLMs) enables task-specific adaptation across diverse datasets while preserving privacy. However, challenges such as high computational and memory demands, heterogeneous client…

Machine Learning · Computer Science 2025-05-19 Yang Su , Na Yan , Yansha Deng , Mischa Dohler , Robert Schober

We present Timer-XL, a causal Transformer for unified time series forecasting. To uniformly predict multidimensional time series, we generalize next token prediction, predominantly adopted for 1D token sequences, to multivariate next token…

Machine Learning · Computer Science 2025-03-04 Yong Liu , Guo Qin , Xiangdong Huang , Jianmin Wang , Mingsheng Long

Federated learning (FL) offers privacy-preserving decentralized machine learning, optimizing models at edge clients without sharing private data. Simultaneously, foundation models (FMs) have gained traction in the artificial intelligence…

Machine Learning · Computer Science 2023-10-06 Sixing Yu , J. Pablo Muñoz , Ali Jannesari

Foundation models for zero-shot time series forecasting face challenges in efficient long-horizon prediction and reproducibility, with existing synthetic-only approaches underperforming on challenging benchmarks. This paper presents…

Machine Learning · Computer Science 2026-02-06 Vladyslav Moroshan , Julien Siems , Arber Zela , Timur Carstensen , Frank Hutter

Today's unsupervised image segmentation algorithms often segment suboptimally. Modern graph-cut based approaches rely on high-dimensional attention maps from Transformer-based foundation models, typically employing a relaxed Normalized Cut…

Computer Vision and Pattern Recognition · Computer Science 2025-04-09 Xiao Zhang , Xiangyu Han , Xiwen Lai , Yao Sun , Pei Zhang , Konrad Kording

Foundation models (FMs) have transformed natural language processing, but their success has not yet translated to time series forecasting. Existing time series foundation models (TSFMs), often based on transformer variants, struggle with…

Machine Learning · Computer Science 2025-08-20 Lars Graf , Thomas Ortner , Stanisław Woźniak , Angeliki Pantazi

We introduce FLEX (FLow EXpert), a backbone architecture for generative modeling of spatio-temporal physical systems using diffusion models. FLEX operates in the residual space rather than on raw data, a modeling choice that we motivate…

Machine Learning · Computer Science 2025-05-26 N. Benjamin Erichson , Vinicius Mikuni , Dongwei Lyu , Yang Gao , Omri Azencot , Soon Hoe Lim , Michael W. Mahoney

Conventional multimodal alignment methods assume mutual redundancy across all modalities, an assumption that fails in real-world distributed scenarios. We propose SheafAlign, a sheaf-theoretic framework for decentralized multimodal…

Machine Learning · Computer Science 2025-10-24 Abdulmomen Ghalkha , Zhuojun Tian , Chaouki Ben Issaid , Mehdi Bennis

Accurate and high-resolution precipitation nowcasting from radar echo sequences is crucial for disaster mitigation and economic planning, yet it remains a significant challenge. Key difficulties include modeling complex multi-scale…

Computer Vision and Pattern Recognition · Computer Science 2026-04-20 Wenjie Luo , Chuanhu Deng , Chaorong Li , Rongyao Deng , Qiang Yang

Time series reasoning is crucial to decision-making in diverse domains, including finance, energy usage, traffic, weather, and scientific discovery. While existing time series foundation models (TSFMs) can capture low-level dynamic patterns…

Computation and Language · Computer Science 2025-10-07 Fangxu Yu , Hongyu Zhao , Tianyi Zhou

We propose X-Fusion, a framework that extends pretrained Large Language Models (LLMs) for multimodal tasks while preserving their language capabilities. X-Fusion employs a dual-tower design with modality-specific weights, keeping the LLM's…

Computer Vision and Pattern Recognition · Computer Science 2025-04-30 Sicheng Mo , Thao Nguyen , Xun Huang , Siddharth Srinivasan Iyer , Yijun Li , Yuchen Liu , Abhishek Tandon , Eli Shechtman , Krishna Kumar Singh , Yong Jae Lee , Bolei Zhou , Yuheng Li

Time series forecasting is essential across domains from finance to supply chain management. This paper introduces ForecastGAN, a novel decomposition based adversarial framework addressing limitations in existing approaches for…

Machine Learning · Computer Science 2025-11-07 Syeda Sitara Wishal Fatima , Afshin Rahimi

Time series foundation models (TSFMs) have recently gained significant attention due to their strong zero-shot capabilities and widespread real-world applications. Such models typically require a computationally costly pre-training on…

This paper introduces FANTF (Fuzzy Attention Network-Based Transformers), a novel approach that integrates fuzzy logic with existing transformer architectures to advance time series forecasting, classification, and anomaly detection tasks.…

Machine Learning · Computer Science 2025-04-02 Sanjay Chakraborty , Fredrik Heintz

Spatiotemporal forecasting has emerged as an indispensable building block of diverse smart city applications, such as intelligent transportation and smart energy management. Recent advancements have uncovered that the performance of…

Machine Learning · Computer Science 2024-09-30 Shuowei Cai , Hao Liu

Recently, deep learning has driven significant advancements in multivariate time series forecasting (MTSF) tasks. However, much of the current research in MTSF tends to evaluate models from a holistic perspective, which obscures the…

Machine Learning · Computer Science 2025-09-23 Shuang Liang , Chaochuan Hou , Xu Yao , Shiping Wang , Minqi Jiang , Songqiao Han , Hailiang Huang

While collaborative forecasting on distributed time series is highly desirable, directly pooling localized datasets is often impractical due to data sharing constraints. Federated learning offers a promising alternative, yet conventional…

Machine Learning · Computer Science 2026-05-26 Yiming Zhou , Jiahao Wang , Mingyue Cheng , Hao Wang , Defu Lian , Enhong Chen

Process Model Forecasting (PMF) aims to predict how the control-flow structure of a process evolves over time by modeling the temporal dynamics of directly-follows (DF) relations, complementing predictive process monitoring that focuses on…

Machine Learning · Computer Science 2025-12-09 Yongbo Yu , Jari Peeperkorn , Johannes De Smedt , Jochen De Weerdt

Time Series Foundation Models (TSFMs) have recently achieved state-of-the-art performance in univariate forecasting on new time series simply by conditioned on a brief history of past values. Their success demonstrates that large-scale…

Machine Learning · Computer Science 2025-09-18 Afrin Dange , Sunita Sarawagi

Deep Neural Networks have spearheaded remarkable advancements in time series forecasting (TSF), one of the major tasks in time series modeling. Nonetheless, the non-stationarity of time series undermines the reliability of pre-trained…

Machine Learning · Computer Science 2025-01-10 HyunGi Kim , Siwon Kim , Jisoo Mok , Sungroh Yoon