English
Related papers

Related papers: Learning Non-Stationary Time-Series with Dynamic P…

200 papers

Recent lightweight MLP-based models have achieved strong performance in time series forecasting by capturing stable trends and seasonal patterns. However, their effectiveness hinges on an implicit assumption of local stationarity…

Machine Learning · Computer Science 2026-01-29 Zhiyu Chen , Minhao Liu , Yanru Zhang

Predicting multivariate time series is crucial, demanding precise modeling of intricate patterns, including inter-series dependencies and intra-series variations. Distinctive trend characteristics in each time series pose challenges, and…

Machine Learning · Computer Science 2024-07-08 Guoqi Yu , Jing Zou , Xiaowei Hu , Angelica I. Aviles-Rivero , Jing Qin , Shujun Wang

Sparse deep learning has become a popular technique for improving the performance of deep neural networks in areas such as uncertainty quantification, variable selection, and large-scale network compression. However, most existing research…

Machine Learning · Statistics 2023-10-06 Mingxuan Zhang , Yan Sun , Faming Liang

Many modern sequential recommender systems use deep neural networks, which can effectively estimate the relevance of items but require a lot of time to train. Slow training increases expenses, hinders product development timescales and…

Information Retrieval · Computer Science 2022-07-18 Aleksandr Petrov , Craig Macdonald

Classical methods of solving spatiotemporal dynamical systems include statistical approaches such as autoregressive integrated moving average, which assume linear and stationary relationships between systems' previous outputs. Development…

Dynamical Systems · Mathematics 2022-02-16 Yonggi Park , Kelum Gajamannage , Dilhani I. Jayathilake , Erik M. Bollt

Multivariate time series forecasting focuses on predicting future values based on historical context. State-of-the-art sequence-to-sequence models rely on neural attention between timesteps, which allows for temporal learning but fails to…

Machine Learning · Computer Science 2023-03-21 Jake Grigsby , Zhe Wang , Nam Nguyen , Yanjun Qi

The Stochastic Volatility (SV) model and its variants are widely used in the financial sector while recurrent neural network (RNN) models are successfully used in many large-scale industrial applications of Deep Learning. Our article…

Econometrics · Economics 2022-01-25 Trong-Nghia Nguyen , Minh-Ngoc Tran , David Gunawan , R. Kohn

The recurrent neural network and its variants have shown great success in processing sequences in recent years. However, this deep neural network has not aroused much attention in anomaly detection through predictively process monitoring.…

Machine Learning · Computer Science 2023-09-06 Jiaqi Qiu , Yu Lin , Inez Zwetsloot

Time-series anomaly detection plays a vital role in monitoring complex operation conditions. However, the detection accuracy of existing approaches is heavily influenced by pattern distribution, existence of multiple normal patterns,…

Machine Learning · Computer Science 2022-02-08 Min Hu , Yi Wang , Xiaowei Feng , Shengchen Zhou , Zhaoyu Wu , Yuan Qin

In the traditional framework of spectral learning of stochastic time series models, model parameters are estimated based on trajectories of fully recorded observations. However, real-world time series data often contain missing values, and…

Machine Learning · Computer Science 2018-10-22 Tianlin Liu

We propose a nonstationary functional time series forecasting method with an application to age-specific mortality rates observed over the years. The method begins by taking the first-order differencing and estimates its long-run covariance…

Methodology · Statistics 2024-11-20 Han Lin Shang , Yang Yang

Long Short-Term Memory (LSTM) networks are often used to capture temporal dependency patterns. By stacking multi-layer LSTM networks, it can capture even more complex patterns. This paper explores the effectiveness of applying stacked LSTM…

Machine Learning · Computer Science 2020-11-03 Frank Xiao

Probabilistic time series forecasting involves estimating the distribution of future based on its history, which is essential for risk management in downstream decision-making. We propose a deep state space model for probabilistic time…

Machine Learning · Computer Science 2021-02-02 Longyuan Li , Junchi Yan , Xiaokang Yang , Yaohui Jin

Temporal distributional shifts, with underlying dynamics changing over time, frequently occur in real-world time series and pose a fundamental challenge for deep neural networks (DNNs). In this paper, we propose a novel deep sequence model…

Machine Learning · Computer Science 2023-03-01 Rui Wang , Yihe Dong , Sercan Ö. Arik , Rose Yu

Although recurrent neural networks (RNNs) are state-of-the-art in numerous sequential decision-making tasks, there has been little research on explaining their predictions. In this work, we present TimeSHAP, a model-agnostic recurrent…

Machine Learning · Computer Science 2021-06-29 João Bento , Pedro Saleiro , André F. Cruz , Mário A. T. Figueiredo , Pedro Bizarro

Reinforcement learning is well known for its ability to model sequential tasks and learn latent data patterns adaptively. Deep learning models have been widely explored and adopted in regression and classification tasks. However, deep…

Machine Learning · Computer Science 2025-06-17 Thanveer Shaik , Xiaohui Tao , Haoran Xie , Lin Li , Jianming Yong , Yuefeng Li

Forecasting the evolution of complex systems is one of the grand challenges of modern data science. The fundamental difficulty lies in understanding the structure of the observed stochastic process. In this paper, we show that every…

Statistics Theory · Mathematics 2020-01-01 Xiucai Ding , Zhou Zhou

While sequence-to-sequence (seq2seq) models achieve state-of-the-art performance in many natural language processing tasks, they can be too slow for real-time applications. One performance bottleneck is predicting the most likely next token…

Computation and Language · Computer Science 2019-07-26 Chunyang Xiao , Christoph Teichmann , Konstantine Arkoudas

Nonlinear and non-stationary processes are prevalent in various natural and physical phenomena, where system dynamics can change qualitatively due to bifurcation phenomena. Traditional machine learning methods have advanced our ability to…

Machine Learning · Statistics 2024-06-21 Keita Tokuda , Yuichi Katori

Recently, evolving networks are becoming a suitable form to model many real-world complex systems, due to their peculiarities to represent the systems and their constituting entities, the interactions between the entities and the…

Artificial Intelligence · Computer Science 2017-09-21 Angelo Impedovo , Corrado Loglisci , Michelangelo Ceci