English
Related papers

Related papers: Disentangled Parameter-Efficient Linear Model for …

200 papers

Despite the prevalent assumption of uniform variable importance in long-term time series forecasting models, real world applications often exhibit asymmetric causal relationships and varying data acquisition costs. Specifically,…

Machine Learning · Computer Science 2026-03-24 Xinyang Chen , Huidong Jin , Yu Huang , Zaiwen Feng

Time Series foundation models (TSFMs) deliver strong forecasting performance through large-scale pretraining, but their large parameter sizes make deployment costly. While knowledge distillation offers a natural and effective approach for…

Machine Learning · Computer Science 2026-01-21 Yuqi Li , Kuiye Ding , Chuanguang Yang , Szu-Yu Chen , Yingli Tian

Transformer-based methods have achieved impressive results in time series forecasting. However, existing Transformers still exhibit limitations in sequence modeling as they tend to overemphasize temporal dependencies. This incurs additional…

Machine Learning · Computer Science 2025-12-16 Tan Wang , Yun Wei Dong , Qi Wang

In response to the challenges posed by the extensive parameter updates required for full fine-tuning of large-scale pre-trained models, parameter-efficient fine-tuning (PEFT) methods, exemplified by Low-Rank Adaptation (LoRA), have emerged.…

Computer Vision and Pattern Recognition · Computer Science 2024-10-11 Junjie Wang , Guangjing Yang , Wentao Chen , Huahui Yi , Xiaohu Wu , Zhouchen Lin , Qicheng Lao

Disentangled representation learning has seen a surge in interest over recent times, generally focusing on new models which optimise one of many disparate disentanglement metrics. Symmetry Based Disentangled Representation learning…

Machine Learning · Computer Science 2021-11-12 Matthew Painter , Jonathon Hare , Adam Prugel-Bennett

In the real world, long sequence time-series forecasting (LSTF) is needed in many cases, such as power consumption prediction and air quality prediction.Multi-dimensional long time series model has more strict requirements on the model,…

Machine Learning · Computer Science 2022-05-11 Ning Wang

In this paper, we introduce the first machine learning framework for predicting optimal processing times in Single-Level Tree Network (SLTN) architectures for the Divisible Load Theory (DLT) paradigm. Using a feedforward neural network(FNN)…

Machine Learning · Computer Science 2026-05-25 Bharadwaj Veeravalli

The expansion of the low-altitude economy has underscored the significance of Low-Altitude Network Coverage (LANC) prediction for designing aerial corridors. While accurate LANC forecasting hinges on the antenna beam patterns of Base…

Networking and Internet Architecture · Computer Science 2026-02-17 Xiaojie Li , Zhijie Cai , Nan Qi , Chao Dong , Guangxu Zhu , Haixia Ma , Qihui Wu , Shi Jin

The increasing integration of distributed energy resources (DERs) calls for new planning and operational tools. However, such tools depend on system topology and line parameters, which may be missing or inaccurate in distribution grids.…

Systems and Control · Computer Science 2017-05-25 Jiafan Yu , Yang Weng , Ram Rajagopal

Modern time series forecasting methods, such as Transformer and its variants, have shown strong ability in sequential data modeling. To achieve high performance, they usually rely on redundant or unexplainable structures to model complex…

Machine Learning · Computer Science 2023-11-30 Jingyi Hou , Zhen Dong , Jiayu Zhou , Zhijie Liu

In recent years, both online and offline deep learning models have been developed for time series forecasting. However, offline deep forecasting models fail to adapt effectively to changes in time-series data, while online deep forecasting…

Machine Learning · Computer Science 2024-02-06 Mohamed Mejri , Chandramouli Amarnath , Abhijit Chatterjee

Sequence modeling faces challenges in capturing long-range dependencies across diverse tasks. Recent linear and transformer-based forecasters have shown superior performance in time series forecasting. However, they are constrained by their…

Machine Learning · Computer Science 2024-11-25 Bong Gyun Kang , Dongjun Lee , HyunGi Kim , DoHyun Chung , Sungroh Yoon

Over the past decade, Finite Element Method (FEM) has served as a foundational numerical framework for approximating the terms of Time Series Expansion (TSE) as solutions to transient Partial Differential Equation (PDE). However, the…

Numerical Analysis · Mathematics 2024-09-04 Ahmad Deeb , Denys Dutykh

Deep Learning (DL) model-based AI services are increasingly offered in a variety of predictive analytics services such as computer vision, natural language processing, speech recognition. However, the quality of the DL models can degrade…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-11-04 Anirban Bhattacharjee , Ajay Dev Chhokra , Hongyang Sun , Shashank Shekhar , Aniruddha Gokhale , Gabor Karsai , Abhishek Dubey

Time series forecasting is critical for decision-making across dynamic domains such as energy, finance, transportation, and cloud computing. However, real-world time series often exhibit non-stationarity, including temporal distribution…

Machine Learning · Computer Science 2025-12-01 Junkai Lu , Peng Chen , Chenjuan Guo , Yang Shu , Meng Wang , Bin Yang

In this work, we present the novel mathematical framework of latent dynamics models (LDMs) for reduced order modeling of parameterized nonlinear time-dependent PDEs. Our framework casts this latter task as a nonlinear dimensionality…

Numerical Analysis · Mathematics 2024-12-02 Nicola Farenga , Stefania Fresca , Simone Brivio , Andrea Manzoni

Long-term time series forecasting (LTSF) aims to predict future values of a time series given the past values. The current state-of-the-art (SOTA) on this problem is attained in some cases by linear-centric models, which primarily feature a…

Machine Learning · Computer Science 2024-05-03 Ronghao Ni , Zinan Lin , Shuaiqi Wang , Giulia Fanti

Multivariate long-term time series forecasting (LTSF) supports critical applications such as traffic-flow management, solar-power scheduling, and electricity-transformer monitoring. The existing LTSF paradigms follow a three-stage pipeline…

Machine Learning · Computer Science 2026-02-03 Hyekyung Yoon , Minhyuk Lee , Imseung Park , Myungjoo Kang

Seasonal time series exhibit intricate long-term dependencies, posing a significant challenge for accurate future prediction. This paper introduces the Multi-scale Seasonal Decomposition Model (MSSD) for seasonal time-series forecasting.…

Machine Learning · Computer Science 2024-12-18 Yining Pang , Chenghan Li

Training deep learning (DL) models in the cloud has become a norm. With the emergence of serverless computing and its benefits of true pay-as-you-go pricing and scalability, systems researchers have recently started to provide support for…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-01-03 Yunzhuo Liu , Bo Jiang , Tian Guo , Zimeng Huang , Wenhao Ma , Xinbing Wang , Chenghu Zhou