English
Related papers

Related papers: Deep Factors with Gaussian Processes for Forecasti…

200 papers

Nonparametric Bayesian approaches based on Gaussian processes have recently become popular in the empirical learning community. They encompass many classical methods of statistics, like Radial Basis Functions or various splines, and are…

Data Analysis, Statistics and Probability · Physics 2007-05-23 J. C. Lemm

Gaussian process is a theoretically appealing model for nonparametric analysis, but its computational cumbersomeness hinders its use in large scale and the existing reduced-rank solutions are usually heuristic. In this work, we propose a…

Machine Learning · Statistics 2015-11-25 Leo L. Duan , Xia Wang , Rhonda D. Szczesniak

The growing field of large-scale time domain astronomy requires methods for probabilistic data analysis that are computationally tractable, even with large datasets. Gaussian Processes are a popular class of models used for this purpose…

Instrumentation and Methods for Astrophysics · Physics 2017-11-15 Daniel Foreman-Mackey , Eric Agol , Sivaram Ambikasaran , Ruth Angus

Deep probabilistic forecasting techniques have recently been proposed for modeling large collections of time-series. However, these techniques explicitly assume either complete independence (local model) or complete dependence (global…

Machine Learning · Computer Science 2020-10-16 Hongjie Chen , Ryan A. Rossi , Kanak Mahadik , Sungchul Kim , Hoda Eldardiry

Deep neural network models have become ubiquitous in recent years, and have been applied to nearly all areas of science, engineering, and industry. These models are particularly useful for data that have strong dependencies in space (e.g.,…

Machine Learning · Statistics 2022-06-07 Christopher K. Wikle , Andrew Zammit-Mangion

Deep learning has been actively applied to time series forecasting, leading to a deluge of new methods, belonging to the class of historical-value models. Yet, despite the attractive properties of time-index models, such as being able to…

Machine Learning · Computer Science 2023-10-18 Gerald Woo , Chenghao Liu , Doyen Sahoo , Akshat Kumar , Steven Hoi

Deep neural networks excel at function approximation, yet they are typically trained from scratch for each new function. On the other hand, Bayesian methods, such as Gaussian Processes (GPs), exploit prior knowledge to quickly infer the…

We propose practical deep Gaussian process models on Riemannian manifolds, similar in spirit to residual neural networks. With manifold-to-manifold hidden layers and an arbitrary last layer, they can model manifold- and scalar-valued…

Machine Learning · Statistics 2025-03-03 Kacper Wyrwal , Andreas Krause , Viacheslav Borovitskiy

Signal processing, communications, and control have traditionally relied on classical statistical modeling techniques. Such model-based methods utilize mathematical formulations that represent the underlying physics, prior information and…

Signal Processing · Electrical Eng. & Systems 2022-09-13 Nir Shlezinger , Jay Whang , Yonina C. Eldar , Alexandros G. Dimakis

Forecasting groups of time series is of increasing practical importance, e.g. forecasting the demand for multiple products offered by a retailer or server loads within a data center. The local approach to this problem considers each time…

Machine Learning · Computer Science 2021-03-30 Pablo Montero-Manso , Rob J Hyndman

Multistage stochastic programming provides a modeling framework for sequential decision-making problems that involve uncertainty. One typically overlooked aspect of this methodology is how uncertainty is incorporated into modeling.…

Optimization and Control · Mathematics 2021-09-24 Juyoung Wang , Mucahit Cevik , Merve Bodur

Computer models are used as a way to explore complex physical systems. Stationary Gaussian process emulators, with their accompanying uncertainty quantification, are popular surrogates for computer models. However, many computer models are…

Methodology · Statistics 2024-11-25 Faezeh Yazdi , Derek Bingham , Daniel Williamson

Time series forecasting plays an increasingly important role in modern business decisions. In today's data-rich environment, people often aim to choose the optimal forecasting model for their data. However, identifying the optimal model…

Applications · Statistics 2021-12-17 Xixi Li , Fotios Petropoulos , Yanfei Kang

Gaussian processes (GPs) offer a flexible, uncertainty-aware framework for modeling complex signals, but scale cubically with data, assume static targets, and are brittle to outliers, limiting their applicability in large-scale problems…

Machine Learning · Statistics 2025-09-23 Fernando Llorente , Daniel Waxman , Sanket Jantre , Nathan M. Urban , Susan E. Minkoff

Gaussian Process (GP) models provide a flexible framework for prediction and uncertainty quantification. For most covariance functions, however, exact GP prediction with $n$ points scales as $\mathcal{O}(n^3)$, making it prohibitively…

Computation · Statistics 2026-05-29 Samanyu Arora , Christopher J. Geoga

In the current context of Big Data, the nature of many forecasting problems has changed from predicting isolated time series to predicting many time series from similar sources. This has opened up the opportunity to develop competitive…

Machine Learning · Computer Science 2021-03-23 Hansika Hewamalage , Christoph Bergmeir , Kasun Bandara

Probabilistic forecasting, i.e. estimating the probability distribution of a time series' future given its past, is a key enabler for optimizing business processes. In retail businesses, for example, forecasting demand is crucial for having…

Artificial Intelligence · Computer Science 2019-02-25 David Salinas , Valentin Flunkert , Jan Gasthaus

We propose a dynamical scaling analysis improved by a deep learning approach. While Gaussian process regression has been widely employed for estimating scaling parameters, its computational cost for parameter optimization becomes a…

Statistical Mechanics · Physics 2026-05-18 Yusuke Terasawa , Yukiyasu Ozeki

This work considers estimation and forecasting in a multivariate, possibly high-dimensional count time series model constructed from a transformation of a latent Gaussian dynamic factor series. The estimation of the latent model parameters…

Methodology · Statistics 2025-04-07 Younghoon Kim , Marie-Christine Düker , Zachary F. Fisher , Vladas Pipiras

Gaussian processes offer a flexible kernel method for regression. While Gaussian processes have many useful theoretical properties and have proven practically useful, they suffer from poor scaling in the number of observations. In…

Machine Learning · Statistics 2021-08-26 Nick Terry , Youngjun Choe