English
Related papers

Related papers: Lightweight Online Adaption for Time Series Founda…

200 papers

Dynamic evaluation of language models (LMs) adapts model parameters at test time using gradient information from previous tokens and substantially improves LM performance. However, it requires over 3x more compute than standard inference.…

Computation and Language · Computer Science 2022-12-06 Kevin Clark , Kelvin Guu , Ming-Wei Chang , Panupong Pasupat , Geoffrey Hinton , Mohammad Norouzi

Multivariate time-series (MTS) forecasting is fundamental to applications ranging from urban mobility and resource management to climate modeling. While recent generative models based on denoising diffusion have advanced state-of-the-art…

Machine Learning · Computer Science 2025-11-21 Seyed Mohamad Moghadas , Bruno Cornelis , Adrian Munteanu

Large Foundation Models (LFMs), including multi-modal and generative models, promise to unlock new capabilities for next-generation Edge AI applications. However, performing inference with LFMs in resource-constrained and heterogeneous edge…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-11-12 Fernando Koch , Aladin Djuhera , Alecio Binotto

Time series foundation models (TSFMs) have demonstrated increasing capabilities due to their extensive pretraining on large volumes of diverse time series data. Consequently, the quality of time series data is crucial to TSFM performance,…

Machine Learning · Computer Science 2026-03-11 Shunyu Wu , Tianyue Li , Yixuan Leng , Jingyi Suo , Jian Lou , Dan Li , See-Kiong Ng

Process Model Forecasting (PMF) aims to predict how the control-flow structure of a process evolves over time by modeling the temporal dynamics of directly-follows (DF) relations, complementing predictive process monitoring that focuses on…

Machine Learning · Computer Science 2025-12-09 Yongbo Yu , Jari Peeperkorn , Johannes De Smedt , Jochen De Weerdt

In recent years, there has been significant progress in the development of fully data-driven global numerical weather prediction models. These machine learning weather prediction models have their strength, notably accuracy and low…

Machine Learning · Statistics 2025-06-05 Alban Farchi , Marcin Chrust , Marc Bocquet , Massimo Bonavita

Federated Learning (FL) facilitates collaborative machine learning by training models on local datasets, and subsequently aggregating these local models at a central server. However, the frequent exchange of model parameters between clients…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-04-15 Liwei Wang , Jun Li , Wen Chen , Qingqing Wu , Ming Ding

Time-series forecasting in real-world applications such as finance and energy often faces challenges due to limited training data and complex, noisy temporal dynamics. Existing deep forecasting models typically supervise predictions using…

Machine Learning · Computer Science 2026-01-14 Jiacheng You , Jingcheng Yang , Yuhang Xie , Zhongxuan Wu , Xiucheng Li , Feng Li , Pengjie Wang , Jian Xu , Bo Zheng , Xinyang Chen

Flow Matching (FM) has shown remarkable ability in modeling complex distributions and achieves strong performance in offline imitation learning for cloning expert behaviors. However, despite its behavioral cloning expressiveness, FM-based…

Machine Learning · Computer Science 2025-10-14 Zhenglin Wan , Jingxuan Wu , Xingrui Yu , Chubin Zhang , Mingcong Lei , Bo An , Ivor Tsang

Winner-take-all competitions in forecasting and machine-learning suffer from distorted incentives. Witkowski et al. 2018 identified this problem and proposed ELF, a truthful mechanism to select a winner. We show that, from a pool of $n$…

Machine Learning · Computer Science 2021-06-14 Rafael Frongillo , Robert Gomez , Anish Thilagar , Bo Waggoner

Accurate decade-scale daily runoff forecasting in small watersheds is difficult because signals blend drifting trends, multi-scale seasonal cycles, regime shifts, and sparse extremes. Prior deep models (DLinear, TimesNet, PatchTST, TiDE,…

Machine Learning · Computer Science 2025-10-07 Qianfei Fan , Jiayu Wei , Peijun Zhu , Wensheng Ye , Meie Fang

This paper considers an alternative method for fitting CARR models using combined estimating functions (CEF) by showing its usefulness in applications in economics and quantitative finance. The associated information matrix for…

Applications · Statistics 2017-02-09 Kok-Haur Ng , Shelton Peiris , Jennifer So-kuen-Chan , David Allen , Kooi-Huat Ng

This paper addresses source component shift adaptation, aiming to update predictions adapting to source component shifts for incoming data streams based on past training data. Existing online learning methods often fail to utilize recurring…

Machine Learning · Computer Science 2025-08-15 Ryuta Matsuno

Multiple federated learning (FL) methods are proposed for traffic flow forecasting (TFF) to avoid heavy-transmission and privacy-leaking concerns resulting from the disclosure of raw data in centralized methods. However, these FL methods…

Machine Learning · Computer Science 2024-11-22 Qingxiang Liu , Sheng Sun , Yuxuan Liang , Xiaolong Xu , Min Liu , Muhammad Bilal , Yuwei Wang , Xujing Li , Yu Zheng

Time series data are prone to noise in various domains, and training samples may contain low-predictability patterns that deviate from the normal data distribution, leading to training instability or convergence to poor local minima.…

Machine Learning · Computer Science 2026-02-19 Xu Zhang , Peng Wang , Yichen Li , Wei Wang

Machine learning force fields (MLFFs) are a promising approach to balance the accuracy of quantum mechanics with the efficiency of classical potentials, yet selecting an optimal model amid increasingly diverse architectures that delivers…

Machine Learning · Computer Science 2025-12-09 Bangchen Yin , Yue Yin , Yuda W. Tang , Hai Xiao

The main objective of this study is to propose an enhanced wind power forecasting (EWPF) transformer model for handling power grid operations and boosting power market competition. It helps reliable large-scale integration of wind power…

Systems and Control · Electrical Eng. & Systems 2023-04-24 Md Rasel Sarkar , Sreenatha G. Anavatti , Tanmoy Dam , Mahardhika Pratama , Berlian Al Kindhi

State-of-the-art results in large language models (LLMs) often rely on scale, which becomes computationally expensive. This has sparked a research agenda to reduce these models' parameter counts and computational costs without significantly…

Computation and Language · Computer Science 2024-11-07 Xiuying Wei , Skander Moalla , Razvan Pascanu , Caglar Gulcehre

Social and collaborative platforms emit multivariate time-series traces in which early interactions-such as views, likes, or downloads-are followed, sometimes months or years later, by higher impact like citations, sales, or reviews. We…

Weather forecasting is crucial for public safety, disaster prevention and mitigation, agricultural production, and energy management, with global relevance. Although deep learning has significantly advanced weather prediction, current…

Machine Learning · Computer Science 2025-02-18 Shixuan Li , Wei Yang , Peiyu Zhang , Xiongye Xiao , Defu Cao , Yuehan Qin , Xiaole Zhang , Yue Zhao , Paul Bogdan