English
Related papers

Related papers: The Bayesian Context Trees State Space Model for t…

200 papers

For exchangeable data, mixture models are an extremely useful tool for density estimation due to their attractive balance between smoothness and flexibility. When additional covariate information is present, mixture models can be extended…

Methodology · Statistics 2023-08-01 Sara Wade , Vanda Inacio , Sonia Petrone

Tree-based ensemble methods, as Random Forests and Gradient Boosted Trees, have been successfully used for regression in many applications and research studies. Furthermore, these methods have been extended in order to deal with uncertainty…

Machine Learning · Computer Science 2018-11-20 Myriam Tami , Marianne Clausel , Emilie Devijver , Adrien Dulac , Eric Gaussier , Stefan Janaqi , Meriam Chebre

Bayesian statistical models allow us to formalise our knowledge about the world and reason about our uncertainty, but there is a need for better procedures to accurately encode its complexity. One way to do so is through compositional…

Computation · Statistics 2017-03-01 Maria Lomeli

In areal unit data with missing or suppressed data, it desirable to create models that are able to predict observations that are not available. Traditional statistical methods achieve this through Bayesian hierarchical models that can…

Methodology · Statistics 2023-12-20 Cara MacBride , Vinny Davies , Duncan Lee

We develop a Bayesian "sum-of-trees" model where each tree is constrained by a regularization prior to be a weak learner, and fitting and inference are accomplished via an iterative Bayesian backfitting MCMC algorithm that generates samples…

Methodology · Statistics 2010-10-08 Hugh A. Chipman , Edward I. George , Robert E. McCulloch

Motivated by the recent success of time-series foundation models for zero-shot forecasting, we present a methodology for $\textit{in-context fine-tuning}$ of a time-series foundation model. In particular, we design a pretrained foundation…

Machine Learning · Computer Science 2024-11-01 Abhimanyu Das , Matthew Faw , Rajat Sen , Yichen Zhou

Bayesian hierarchical models are used to share information between related samples and obtain more accurate estimates of sample-level parameters, common structure, and variation between samples. When the parameter of interest is the…

Methodology · Statistics 2019-06-18 Jonathan Christensen , Li Ma

Mixture models provide a flexible representation of heterogeneity in a finite number of latent classes. From the Bayesian point of view, Markov Chain Monte Carlo methods provide a way to draw inferences from these models. In particular,…

Methodology · Statistics 2020-05-06 Carolina Valani Cavalcante , Kelly Cristina Mota Gonçalves

Complex Event Recognition (CER) systems have become popular in the past two decades due to their ability to "instantly" detect patterns on real-time streams of events. However, there is a lack of methods for forecasting when a pattern might…

Databases · Computer Science 2021-09-02 Elias Alevizos , Alexander Artikis , Georgios Paliouras

Hierarchical structure is ubiquitous in data across many domains. There are many hierarchical clustering methods, frequently used by domain experts, which strive to discover this structure. However, most of these methods limit discoverable…

Machine Learning · Computer Science 2012-03-19 Charles Blundell , Yee Whye Teh , Katherine A. Heller

A Bayesian approach is developed to analyze change points in multivariate time series and space-time data. The methodology is used to assess the impact of extended inundation on the ecosystem of the Gulf Plains bioregion in northern…

Methodology · Statistics 2013-06-21 Chris Strickland , Robert Burdett , Robert Denham , Robert Kohn , Kerrie Mengersen

A novel unified Bayesian framework for network detection is developed, under which a detection algorithm is derived based on random walks on graphs. The algorithm detects threat networks using partial observations of their activity, and is…

Social and Information Networks · Computer Science 2014-09-09 Steven T. Smith , Edward K. Kao , Kenneth D. Senne , Garrett Bernstein , Scott Philips

Tree ensemble models such as random forests and boosted trees are among the most widely used and practically successful predictive models in applied machine learning and business analytics. Although such models have been used to make…

Optimization and Control · Mathematics 2019-10-11 Velibor V. Mišić

Sequential model-based optimization sequentially selects a candidate point by constructing a surrogate model with the history of evaluations, to solve a black-box optimization problem. Gaussian process (GP) regression is a popular choice as…

Machine Learning · Statistics 2022-02-23 Jungtaek Kim , Seungjin Choi

The appropriateness of the Poisson model is frequently challenged when examining spatial count data marked by unbalanced distributions, over-dispersion, or under-dispersion. Moreover, traditional parametric models may inadequately capture…

Methodology · Statistics 2025-03-26 Mahsa Nadifar , Andriette Bekker , Mohammad Arashi , Abel Ramoelo

Due to spatial dependence -- often characterized as complex and non-linear -- model misspecification is a prevalent and critical issue in spatial data analysis and prediction. As the data, and thus model performance, is heterogeneous,…

In many data-driven applications, collecting data from different sources is increasingly desirable for enhancing performance. In this paper, we are interested in the problem of probabilistic forecasting with multi-source time series. We…

Machine Learning · Computer Science 2023-02-23 Tian Guo

We propose Partition Tree, a novel tree-based framework for conditional density estimation over general outcome spaces that supports both continuous and categorical variables within a unified formulation. Our approach models conditional…

Machine Learning · Computer Science 2026-05-13 Felipe Angelim , Alessandro Leite

This paper develops a novel stochastic tree ensemble method for nonlinear regression, which we refer to as XBART, short for Accelerated Bayesian Additive Regression Trees. By combining regularization and stochastic search strategies from…

Machine Learning · Statistics 2021-06-04 Jingyu He , P. Richard Hahn

The paper introduces a general framework for statistical analysis of functional time series from a Bayesian perspective. The proposed approach, based on an extension of the popular dynamic linear model to Banach-space valued observations…

Methodology · Statistics 2013-12-02 Giovanni Petris