English
Related papers

Related papers: MSMixer: Learned Multi-Scale Temporal Mixing with …

200 papers

Balancing the workload of sophisticated simulations is inherently difficult, since we have to balance both computational workload and memory footprint over meshes that can change any time or yield unpredictable cost per mesh entity, while…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-08-04 Philipp Samfass , Tobias Weinzierl , Dominic E. Charrier , Michael Bader

Recent advances in lightweight time series forecasting models suggest the inherent simplicity of time series forecasting tasks. In this paper, we present CMoS, a super-lightweight time series forecasting model. Instead of learning the…

Machine Learning · Computer Science 2025-05-27 Haotian Si , Changhua Pei , Jianhui Li , Dan Pei , Gaogang Xie

Real-time sequential control agents are often bottlenecked by inference latency. Even modest per-step planning delays can destabilize control and degrade overall performance. We propose a speculation-and-correction framework that adapts the…

Artificial Intelligence · Computer Science 2025-12-22 Ziyang Lin , Zixuan Sun , Sanhorn Chen , Xiaoyang Chen , Roy Zhao

Deep ensemble methods often improve predictive performance, yet they suffer from three practical limitations: redundancy among base models that inflates computational cost and degrades conditioning, unstable weighting under…

Machine Learning · Computer Science 2026-04-27 Noor Islam S. Mohammad , Md Muntaqim Meherab

Recent advancements in long-term time series forecasting (LTSF) have primarily focused on capturing cross-time and cross-variate (channel) dependencies within historical data. However, a critical aspect often overlooked by many existing…

Machine Learning · Computer Science 2024-12-03 Chaolv Zeng , Yuan Tian , Guanjie Zheng , Yunjun Gao

The attention mechanism has become a go-to technique for natural language processing and computer vision tasks. Recently, the MLP-Mixer and other MLP-based architectures, based simply on multi-layer perceptrons (MLPs), are also powerful…

Computer Vision and Pattern Recognition · Computer Science 2022-05-31 Tian Lv , Chongyang Bai , Chaojie Wang

The efficiency of business processes relies on business key performance indicators (Biz-KPIs), that can be negatively impacted by IT failures. Business and IT Observability (BizITObs) data fuses both Biz-KPIs and IT event channels together…

Recent advancements in multivariate time series forecasting have been propelled by Linear-based, Transformer-based, and Convolution-based models, with Transformer-based architectures gaining prominence for their efficacy in temporal and…

Machine Learning · Computer Science 2024-09-27 Chaolv Zeng , Zhanyu Liu , Guanjie Zheng , Linghe Kong

Linear mixed models (LMMs) are used as an important tool in the data analysis of repeated measures and longitudinal studies. The most common form of LMMs utilize a normal distribution to model the random effects. Such assumptions can often…

Methodology · Statistics 2016-02-16 Hien D. Nguyen , Geoffrey J. McLachlan

Time-series is ubiquitous across applications, such as transportation, finance and healthcare. Time-series is often influenced by external factors, especially in the form of asynchronous events, making forecasting difficult. However,…

Machine Learning · Computer Science 2021-02-02 Longyuan Li , Jihai Zhang , Junchi Yan , Yaohui Jin , Yunhao Zhang , Yanjie Duan , Guangjian Tian

Since its introduction, the transformer has shifted the development trajectory away from traditional models (e.g., RNN, MLP) in time series forecasting, which is attributed to its ability to capture global dependencies within temporal…

Machine Learning · Computer Science 2025-01-07 Xiwen Chen , Peijie Qiu , Wenhui Zhu , Huayu Li , Hao Wang , Aristeidis Sotiras , Yalin Wang , Abolfazl Razi

Recent research in time series forecasting has explored integrating multimodal features into models to improve accuracy. However, the accuracy of such methods is constrained by three key challenges: inadequate extraction of fine-grained…

Machine Learning · Computer Science 2025-10-21 Shule Hao , Junpeng Bao , Wenli Li

Transformers have demonstrated impressive strength in long-term series forecasting. Existing prediction research mostly focused on mapping past short sub-series (lookback window) to future series (forecast window). The longer training…

Machine Learning · Computer Science 2023-02-22 Julong Young , Junhui Chen , Feihu Huang , Jian Peng

Multivariate time series long-term prediction, which aims to predict the change of data in a long time, can provide references for decision-making. Although transformer-based models have made progress in this field, they usually do not make…

Machine Learning · Computer Science 2023-08-08 Chengqing Yu , Fei Wang , Zezhi Shao , Tao Sun , Lin Wu , Yongjun Xu

Fueled by recent advances of self-supervised models, pre-trained speech representations proved effective for the downstream speech emotion recognition (SER) task. Most prior works mainly focus on exploiting pre-trained representations and…

Sound · Computer Science 2023-03-02 Siyuan Shen , Feng Liu , Aimin Zhou

Learning effective feature interactions is central to modern recommender systems, yet remains challenging in industrial settings due to sparse multi-field inputs and ultra-long user behavior sequences. While recent scaling efforts have…

Information Retrieval · Computer Science 2026-02-13 Fangye Wang , Guowei Yang , Xiaojiang Zhou , Song Yang , Pengjie Wang

The problem of Time-series Forecasting is generally addressed by recurrent, Transformer-based and the recently proposed Mamba-based architectures. However, existing architectures generally process their input at a single temporal scale,…

Machine Learning · Computer Science 2026-03-06 Yusuf Meric Karadag , Ismail Talaz , Ipek Gursel Dino , Sinan Kalkan

Probabilistic forecasting of high dimensional multivariate time series is a notoriously challenging task, both in terms of computational burden and distribution modeling. Most previous work either makes simple distribution assumptions or…

Machine Learning · Computer Science 2021-01-27 Nam Nguyen , Brian Quanz

Time series classification (TSC) performance depends not only on architectural design but also on the diversity of input representations. In this work, we propose a scalable multi-scale convolutional framework that systematically integrates…

Machine Learning · Computer Science 2026-03-26 Celal Alagöz , Mehmet Kurnaz , Farhan Aadil

We developed a least squares fitter used for extracting expected physics parameters from the correlated experimental data in high energy physics. This fitter considers the correlations among the observables and handles the nonlinearity…

High Energy Physics - Experiment · Physics 2013-11-15 Yinghui Guan , Xiao-Rui Lu , Yangheng Zheng , Yong-Sheng Zhu