English
Related papers

Related papers: ReLaMix: Residual Latency-Aware Mixing for Delay-R…

200 papers

Industrial prognostics focuses on utilizing degradation signals to forecast and continually update the residual useful life of complex engineering systems. However, existing prognostic models for systems with multiple failure modes face…

Machine Learning · Computer Science 2025-01-15 Yuqi Su , Xiaolei Fang

Large language model inference is both memory-intensive and time-consuming, often requiring distributed algorithms to efficiently scale. Various model parallelism strategies are used in multi-gpu training and inference to partition…

Long-term time series forecasting (LTSF) is a critical task in computational intelligence. While Transformer-based models effectively capture long-range dependencies, they often suffer from quadratic complexity and overfitting due to data…

Machine Learning · Computer Science 2025-12-03 Li Qianyang , Zhang Xingjun , Wang Shaoxun , Wei Jia

We propose a hybrid meta-learning framework for forecasting and anomaly detection in nonlinear dynamical systems characterized by nonstationary and stochastic behavior. The approach integrates a physics-inspired simulator that captures…

Machine Learning · Computer Science 2025-06-18 Abdullah Burkan Bereketoglu

Time series data appears in a variety of applications such as smart transportation and environmental monitoring. One of the fundamental problems for time series analysis is time series forecasting. Despite the success of recent deep time…

Artificial Intelligence · Computer Science 2022-09-28 Baoyu Jing , Si Zhang , Yada Zhu , Bin Peng , Kaiyu Guan , Andrew Margenot , Hanghang Tong

Retinex-based low-light image enhancement benefits from separating reflectance and illumination, yet recent generative approaches often rely on iterative sampling and are difficult to deploy under strict latency budgets. Consistency models…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Jian Xu , Wei Chen , Shigui Li , Delu Zeng , John Paisley , Qibin Zhao

Accurate forecasting of financial markets remains a long-standing challenge due to complex temporal and often latent dependencies, non-linear dynamics, and high volatility. Building on our earlier recurrent neural network framework, we…

Computational Engineering, Finance, and Science · Computer Science 2026-01-05 Shaswat Mohanty

Large language models (LLMs) have shown remarkable performance across diverse reasoning and generation tasks, and are increasingly deployed as agents in dynamic environments such as code generation and recommendation systems. However, many…

Machine Learning · Computer Science 2025-05-27 Hao Kang , Qingru Zhang , Han Cai , Weiyuan Xu , Tushar Krishna , Yilun Du , Tsachy Weissman

Limit order books can transition rapidly from stable to stressed conditions, yet standard early-warning signals such as order flow imbalance and short-term volatility are inherently reactive. We formalise this limitation via a three-regime…

Machine Learning · Computer Science 2026-04-24 Prakul Sunil Hiremath , Vruksha Arun Hiremath

Data stream forecasts are essential inputs for decision making at digital platforms. Machine learning algorithms are appealing candidates to produce such forecasts. Yet, digital platforms require a large-scale forecast framework that can…

Applications · Statistics 2024-01-18 Jeroen Rombouts , Ines Wilms

While time series momentum is a well-studied phenomenon in finance, common strategies require the explicit definition of both a trend estimator and a position sizing rule. In this paper, we introduce Deep Momentum Networks -- a hybrid…

Machine Learning · Statistics 2020-09-29 Bryan Lim , Stefan Zohren , Stephen Roberts

Delay embedding---a method for reconstructing dynamical systems by delay coordinates---is widely used to forecast nonlinear time series as a model-free approach. When multivariate time series are observed, several existing frameworks can be…

Machine Learning · Statistics 2019-07-04 Shunya Okuno , Kazuyuki Aihara , Yoshito Hirata

Residual transformations enhance the representational depth and expressive power of large language models (LLMs). However, applying static residual transformations across all tokens in auto-regressive generation leads to a suboptimal…

Computation and Language · Computer Science 2025-02-05 Nikhil Bhendawade , Mahyar Najibi , Devang Naik , Irina Belousova

Weather prediction is a quintessential problem involving the forecasting of a complex, nonlinear, and chaotic high-dimensional dynamical system. This work introduces an efficient reduced-order modeling (ROM) framework for short-range…

Machine Learning · Computer Science 2025-11-18 Amirpasha Hedayat , Karthik Duraisamy

Recurrent binary outcomes within individuals, such as hospital readmissions, often reflect latent risk processes that evolve over time. Conventional methods like generalized linear mixed models and generalized estimating equations estimate…

Methodology · Statistics 2026-02-24 Niloofar Ramezani , Lori P. Selby , Pascal Nitiema , Jeffrey R. Wilson

Transformers are the de-facto choice for sequence modelling, yet their quadratic self-attention and weak temporal bias can make long-range forecasting both expensive and brittle. We introduce FreezeTST, a lightweight hybrid that interleaves…

Machine Learning · Computer Science 2025-10-21 Pradeep Singh , Mehak Sharma , Anupriya Dey , Balasubramanian Raman

In this work, we show that Latent Flow-Matching (LFM) models are robust to different types of perturbations, including data reduction and model capacity shrinkage. We characterize this stability by their tendency to generate similar outputs…

Machine Learning · Computer Science 2026-05-12 Rania Briq , Michael Kamp , Ohad Fried , Sarel Cohen , Stefan Kesselheim

Subpopulation shift exists widely in many real-world applications, which refers to the training and test distributions that contain the same subpopulation groups but with different subpopulation proportions. Ignoring subpopulation shifts…

Machine Learning · Computer Science 2023-04-11 Zongbo Han , Zhipeng Liang , Fan Yang , Liu Liu , Lanqing Li , Yatao Bian , Peilin Zhao , Qinghua Hu , Bingzhe Wu , Changqing Zhang , Jianhua Yao

Training deep recurrent neural network (RNN) architectures is complicated due to the increased network complexity. This disrupts the learning of higher order abstracts using deep RNN. In case of feed-forward networks training deep…

Computation and Language · Computer Science 2018-08-07 Murali Karthick Baskar , Martin Karafiat , Lukas Burget , Karel Vesely , Frantisek Grezl , Jan Honza Cernocky

Planning based on long and short term time series forecasts is a common practice across many industries. In this context, temporal aggregation and reconciliation techniques have been useful in improving forecasts, reducing model…

Machine Learning · Computer Science 2022-01-31 Himanshi Charotia , Abhishek Garg , Gaurav Dhama , Naman Maheshwari