中文
相关论文

相关论文: Falcon-X: A Time Series Foundation Model for Heter…

200 篇论文

Federated fine-tuning of pre-trained Large Language Models (LLMs) enables task-specific adaptation across diverse datasets while preserving privacy. However, challenges such as high computational and memory demands, heterogeneous client…

机器学习 · 计算机科学 2025-05-19 Yang Su , Na Yan , Yansha Deng , Mischa Dohler , Robert Schober

We present Timer-XL, a causal Transformer for unified time series forecasting. To uniformly predict multidimensional time series, we generalize next token prediction, predominantly adopted for 1D token sequences, to multivariate next token…

机器学习 · 计算机科学 2025-03-04 Yong Liu , Guo Qin , Xiangdong Huang , Jianmin Wang , Mingsheng Long

Federated learning (FL) offers privacy-preserving decentralized machine learning, optimizing models at edge clients without sharing private data. Simultaneously, foundation models (FMs) have gained traction in the artificial intelligence…

机器学习 · 计算机科学 2023-10-06 Sixing Yu , J. Pablo Muñoz , Ali Jannesari

Foundation models for zero-shot time series forecasting face challenges in efficient long-horizon prediction and reproducibility, with existing synthetic-only approaches underperforming on challenging benchmarks. This paper presents…

机器学习 · 计算机科学 2026-02-06 Vladyslav Moroshan , Julien Siems , Arber Zela , Timur Carstensen , Frank Hutter

Today's unsupervised image segmentation algorithms often segment suboptimally. Modern graph-cut based approaches rely on high-dimensional attention maps from Transformer-based foundation models, typically employing a relaxed Normalized Cut…

计算机视觉与模式识别 · 计算机科学 2025-04-09 Xiao Zhang , Xiangyu Han , Xiwen Lai , Yao Sun , Pei Zhang , Konrad Kording

Foundation models (FMs) have transformed natural language processing, but their success has not yet translated to time series forecasting. Existing time series foundation models (TSFMs), often based on transformer variants, struggle with…

机器学习 · 计算机科学 2025-08-20 Lars Graf , Thomas Ortner , Stanisław Woźniak , Angeliki Pantazi

We introduce FLEX (FLow EXpert), a backbone architecture for generative modeling of spatio-temporal physical systems using diffusion models. FLEX operates in the residual space rather than on raw data, a modeling choice that we motivate…

Conventional multimodal alignment methods assume mutual redundancy across all modalities, an assumption that fails in real-world distributed scenarios. We propose SheafAlign, a sheaf-theoretic framework for decentralized multimodal…

机器学习 · 计算机科学 2025-10-24 Abdulmomen Ghalkha , Zhuojun Tian , Chaouki Ben Issaid , Mehdi Bennis

Accurate and high-resolution precipitation nowcasting from radar echo sequences is crucial for disaster mitigation and economic planning, yet it remains a significant challenge. Key difficulties include modeling complex multi-scale…

计算机视觉与模式识别 · 计算机科学 2026-04-20 Wenjie Luo , Chuanhu Deng , Chaorong Li , Rongyao Deng , Qiang Yang

Time series reasoning is crucial to decision-making in diverse domains, including finance, energy usage, traffic, weather, and scientific discovery. While existing time series foundation models (TSFMs) can capture low-level dynamic patterns…

计算与语言 · 计算机科学 2025-10-07 Fangxu Yu , Hongyu Zhao , Tianyi Zhou

We propose X-Fusion, a framework that extends pretrained Large Language Models (LLMs) for multimodal tasks while preserving their language capabilities. X-Fusion employs a dual-tower design with modality-specific weights, keeping the LLM's…

Time series forecasting is essential across domains from finance to supply chain management. This paper introduces ForecastGAN, a novel decomposition based adversarial framework addressing limitations in existing approaches for…

机器学习 · 计算机科学 2025-11-07 Syeda Sitara Wishal Fatima , Afshin Rahimi

Time series foundation models (TSFMs) have recently gained significant attention due to their strong zero-shot capabilities and widespread real-world applications. Such models typically require a computationally costly pre-training on…

This paper introduces FANTF (Fuzzy Attention Network-Based Transformers), a novel approach that integrates fuzzy logic with existing transformer architectures to advance time series forecasting, classification, and anomaly detection tasks.…

机器学习 · 计算机科学 2025-04-02 Sanjay Chakraborty , Fredrik Heintz

Spatiotemporal forecasting has emerged as an indispensable building block of diverse smart city applications, such as intelligent transportation and smart energy management. Recent advancements have uncovered that the performance of…

机器学习 · 计算机科学 2024-09-30 Shuowei Cai , Hao Liu

Recently, deep learning has driven significant advancements in multivariate time series forecasting (MTSF) tasks. However, much of the current research in MTSF tends to evaluate models from a holistic perspective, which obscures the…

机器学习 · 计算机科学 2025-09-23 Shuang Liang , Chaochuan Hou , Xu Yao , Shiping Wang , Minqi Jiang , Songqiao Han , Hailiang Huang

While collaborative forecasting on distributed time series is highly desirable, directly pooling localized datasets is often impractical due to data sharing constraints. Federated learning offers a promising alternative, yet conventional…

机器学习 · 计算机科学 2026-05-26 Yiming Zhou , Jiahao Wang , Mingyue Cheng , Hao Wang , Defu Lian , Enhong Chen

Process Model Forecasting (PMF) aims to predict how the control-flow structure of a process evolves over time by modeling the temporal dynamics of directly-follows (DF) relations, complementing predictive process monitoring that focuses on…

机器学习 · 计算机科学 2025-12-09 Yongbo Yu , Jari Peeperkorn , Johannes De Smedt , Jochen De Weerdt

Time Series Foundation Models (TSFMs) have recently achieved state-of-the-art performance in univariate forecasting on new time series simply by conditioned on a brief history of past values. Their success demonstrates that large-scale…

机器学习 · 计算机科学 2025-09-18 Afrin Dange , Sunita Sarawagi

Deep Neural Networks have spearheaded remarkable advancements in time series forecasting (TSF), one of the major tasks in time series modeling. Nonetheless, the non-stationarity of time series undermines the reliability of pre-trained…

机器学习 · 计算机科学 2025-01-10 HyunGi Kim , Siwon Kim , Jisoo Mok , Sungroh Yoon