English
Related papers

Related papers: The ARR2 prior: flexible predictive prior definiti…

200 papers

Machine learning models often perform poorly under subpopulation shifts in the data distribution. Developing methods that allow machine learning models to better generalize to such shifts is crucial for safe deployment in real-world…

Machine Learning · Statistics 2024-03-18 Tim G. J. Rudner , Ya Shi Zhang , Andrew Gordon Wilson , Julia Kempe

The variational autoencoder (VAE) is a powerful generative model that can estimate the probability of a data point by using latent variables. In the VAE, the posterior of the latent variable given the data point is regularized by the prior…

Machine Learning · Statistics 2019-12-30 Hiroshi Takahashi , Tomoharu Iwata , Yuki Yamanaka , Masanori Yamada , Satoshi Yagi

In recent years, shrinkage priors have received much attention in high-dimensional data analysis from a Bayesian perspective. Compared with widely used spike-and-slab priors, shrinkage priors have better computational efficiency. But the…

Statistics Theory · Mathematics 2020-01-16 Ruoyang Zhang , Malay Ghosh

We show that regularizing Bayesian predictive regressions provides a framework for prior sensitivity analysis. We develop a procedure that jointly regularizes expectations and variance-covariance matrices using a pair of shrinkage priors.…

Methodology · Statistics 2017-09-15 Guanhao Feng , Nicholas G. Polson

One of the core facets of Bayesianism is in the updating of prior beliefs in light of new evidence$\text{ -- }$so how can we maintain a Bayesian approach if we have no prior beliefs in the first place? This is one of the central challenges…

Machine Learning · Statistics 2026-02-10 Tommy Rochussen , Vincent Fortuin

This paper presents Randomized AutoRegressive modeling (RAR) for visual generation, which sets a new state-of-the-art performance on the image generation task while maintaining full compatibility with language modeling frameworks. The…

Computer Vision and Pattern Recognition · Computer Science 2024-11-04 Qihang Yu , Ju He , Xueqing Deng , Xiaohui Shen , Liang-Chieh Chen

We develop a new efficient algorithm for the analysis of large-scale time series data. We firstly define rolling averages, derive their analytical properties, and establish their asymptotic distribution. These theoretical results are…

Methodology · Statistics 2022-12-26 Ali Eshragh , Glen Livingston , Thomas McCarthy McCann , Luke Yerbury

Shape restricted regressions, including isotonic regression and concave regression as special cases, are studied using priors on Bernstein polynomials and Markov chain Monte Carlo methods. These priors have large supports, select only…

Statistics Theory · Mathematics 2009-09-29 I-Shou Chang , Li-Chu Chien , Chao A. Hsiung , Chi-Chung Wen , Yuh-Jenn Wu

Autoregressive models are a class of time series models that are important in both applied and theoretical statistics. Typically, inferential devices such as confidence sets and hypothesis tests for time series models require nuanced…

Statistics Theory · Mathematics 2022-01-19 Hien Duy Nguyen

This paper describes two intelligibility prediction systems derived from a pretrained noise-robust automatic speech recognition (ASR) model for the second Clarity Prediction Challenge (CPC2). One system is intrusive and leverages the hidden…

Audio and Speech Processing · Electrical Eng. & Systems 2023-11-01 Zehai Tu , Ning Ma , Jon Barker

A buffered double autoregressive (BDAR) time series model is proposed in this paper to depict the buffering phenomenon of conditional mean and conditional variance in time series. To build this model, a novel flexible regime switching…

Methodology · Statistics 2018-10-30 Zhao Liu

Motivated by the remarkable success of Bayesian additive regression trees (BART) in regression modelling, we propose a novel nonparametric Bayesian method, termed Functional BART (FBART), tailored specifically for function-on-scalar…

Methodology · Statistics 2025-06-03 Jiahao Cao , Shiyuan He , Bohai Zhang

Time Series forecasting (univariate and multivariate) is a problem of high complexity due the different patterns that have to be detected in the input, ranging from high to low frequencies ones. In this paper we propose a new model for…

Machine Learning · Computer Science 2019-03-07 Matteo Maggiolo , Gerasimos Spanakis

Transfer learning (TL) has emerged as a powerful tool to supplement data collected for a target task with data collected for a related source task. The Bayesian framework is natural for TL because information from the source data can be…

Methodology · Statistics 2024-06-06 Mohamed A. Abba , Jonathan P. Williams , Brian J. Reich

Probabilistic forecasting of time series is an important matter in many applications and research fields. In order to draw conclusions from a probabilistic forecast, we must ensure that the model class used to approximate the true…

Machine Learning · Computer Science 2022-07-12 David Rügamer , Philipp F. M. Baumann , Thomas Kneib , Torsten Hothorn

Principal component regression uses principal components as regressors. It is particularly useful in prediction settings with high-dimensional covariates. The existing literature treating of Bayesian approaches is relatively sparse. We…

Methodology · Statistics 2020-01-28 Philippe Gagnon , Mylène Bédard , Alain Desgagné

Amortized inference promises fast test-time Bayesian inference, but existing methods are inherently tied to fixed models. Extending amortization to unseen models typically requires retraining or costly test-time finetuning. In this paper,…

Machine Learning · Computer Science 2026-05-27 Joohwan Ko , Justin Domke

Many statistical problems include model parameters that are defined as the solutions to optimization sub-problems. These include classical approaches such as profile likelihood as well as modern applications involving flow networks or…

Methodology · Statistics 2025-03-17 Cheng Zeng , Yaozhi Yang , Jason Xu , Leo L Duan

Variational Auto-encoders (VAEs) have been very successful as methods for forming compressed latent representations of complex, often high-dimensional, data. In this paper, we derive an alternative variational lower bound from the one…

Machine Learning · Computer Science 2019-03-20 Shuyu Lin , Ronald Clark , Robert Birke , Niki Trigoni , Stephen Roberts

Automatic amortized resource analysis (AARA) is a type-based technique for inferring concrete (non-asymptotic) bounds on a program's resource usage. Existing work on AARA has focused on bounds that are polynomial in the sizes of the inputs.…

Programming Languages · Computer Science 2020-03-09 David M Kahn , Jan Hoffmann