English
Related papers

Related papers: VQ-AR: Vector Quantized Autoregressive Probabilist…

200 papers

Understanding the time-varying structure of complex temporal systems is one of the main challenges of modern time series analysis. In this paper, we show that every uniformly-positive-definite-in-covariance and sufficiently short-range…

Statistics Theory · Mathematics 2023-04-25 Xiucai Ding , Zhou Zhou

Time series forecasting is a fundamental task emerging from diverse data-driven applications. Many advanced autoregressive methods such as ARIMA were used to develop forecasting models. Recently, deep learning based methods such as DeepAr,…

Real-world deep learning models developed for Time Series Forecasting are used in several critical applications ranging from medical devices to the security domain. Many previous works have shown how deep learning models are prone to…

Machine Learning · Computer Science 2023-01-30 Yuvaraj Govindarajulu , Avinash Amballa , Pavan Kulkarni , Manojkumar Parmar

Time series forecasting is essential for agents to make decisions. Traditional approaches rely on statistical methods to forecast given past numeric values. In practice, end-users often rely on visualizations such as charts and plots to…

Computer Vision and Pattern Recognition · Computer Science 2021-11-23 Srijan Sood , Zhen Zeng , Naftali Cohen , Tucker Balch , Manuela Veloso

Time series forecasting is an important problem across many domains, playing a crucial role in multiple real-world applications. In this paper, we propose a forecasting architecture that combines deep autoregressive models with a Spectral…

Machine Learning · Statistics 2021-12-28 Fernando Moreno-Pino , Pablo M. Olmos , Antonio Artés-Rodríguez

Time series prediction with missing values is an important problem of time series analysis since complete data is usually hard to obtain in many real-world applications. To model the generation of time series, autoregressive (AR) model is a…

Machine Learning · Statistics 2019-08-28 Xi Chen , Hongzhi Wang , Yanjie Wei , Jianzhong Li , Hong Gao

While classical time series forecasting considers individual time series in isolation, recent advances based on deep learning showed that jointly learning from a large pool of related time series can boost the forecasting accuracy. However,…

Machine Learning · Computer Science 2021-11-15 Riccardo Grazzi , Valentin Flunkert , David Salinas , Tim Januschowski , Matthias Seeger , Cedric Archambeau

Recent advancements in learning Discrete Representations as opposed to continuous ones have led to state of art results in tasks that involve Language, Audio and Vision. Some latent factors such as words, phonemes and shapes are better…

Machine Learning · Computer Science 2020-04-14 Iordanis Fostiropoulos

Generative modeling offers a promising solution to data scarcity and privacy challenges in time series analysis. However, the structural complexity of time series, characterized by multi-scale temporal patterns and heterogeneous components,…

Machine Learning · Computer Science 2026-01-19 Xiangyu Xu , Qingsong Zhong , Jilin Hu

Current time-series forecasting models are primarily based on transformer-style neural networks. These models achieve long-term forecasting mainly by scaling up the model size rather than through genuinely autoregressive (AR) rollout. From…

Machine Learning · Computer Science 2026-05-08 Zheng Li , Jerry Cheng , Huanying Gu

Developments in Deep Learning have significantly improved time series forecasting by enabling more accurate modeling of complex temporal dependencies inherent in sequential data. The effectiveness of such models is often demonstrated on…

Machine Learning · Computer Science 2025-11-19 Victoria Hankemeier , Malte Schilling

This paper gives an overview on how to develop a dense and deep neural network for making a time series prediction. First, the history and cornerstones in Artificial Intelligence and Machine Learning will be presented. After a short…

Machine Learning · Computer Science 2025-03-11 Bojan Lukić

In modelling complex processes, the potential past data that influence future expectations are immense. Models that track all this data are not only computationally wasteful but also shed little light on what past data most influence the…

In this paper, we introduce ProNet, an novel deep learning approach designed for multi-horizon time series forecasting, adaptively blending autoregressive (AR) and non-autoregressive (NAR) strategies. Our method involves dividing the…

Machine Learning · Computer Science 2024-08-13 Yang Lin

Autoregressive Predictive Coding (APC), as a self-supervised objective, has enjoyed success in learning representations from large amounts of unlabeled data, and the learned representations are rich for many downstream tasks. However, the…

Audio and Speech Processing · Electrical Eng. & Systems 2020-05-19 Yu-An Chung , Hao Tang , James Glass

For autoregressive (AR) modeling of high-resolution images, vector quantization (VQ) represents an image as a sequence of discrete codes. A short sequence length is important for an AR model to reduce its computational costs to consider…

Computer Vision and Pattern Recognition · Computer Science 2022-03-10 Doyup Lee , Chiheon Kim , Saehoon Kim , Minsu Cho , Wook-Shin Han

While deep feature learning has revolutionized techniques for static-image understanding, the same does not quite hold for video processing. Architectures and optimization techniques used for video are largely based off those for static…

Computer Vision and Pattern Recognition · Computer Science 2017-12-13 Achal Dave , Olga Russakovsky , Deva Ramanan

The class of autoregressive (AR) processes is extensively used to model temporal dependence in observed time series. Such models are easily available and routinely fitted using freely available statistical software like R. A potential…

Methodology · Statistics 2020-10-13 Sigrunn H. Sørbye , Pedro G. Nicolau , Håvard Rue

The vector autoregressive (VAR) model has been used to describe the dependence within and across multiple time series. This is a model for stationary time series which can be extended to allow the presence of a deterministic trend in each…

Methodology · Statistics 2025-10-14 Xixi Li , Jingsong Yuan

Vector-quantized based models have recently demonstrated strong potential for visual prior modeling. However, existing VQ-based methods simply encode visual features with nearest codebook items and train index predictor with code-level…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Qifan Li , Jiale Zou , Jinhua Zhang , Wei Long , Xingyu Zhou , Shuhang Gu