English
Related papers

Related papers: Penalised complexity priors for stationary autoreg…

200 papers

Predictive coding (PC) accounts of perception now form one of the dominant computational theories of the brain, where they prescribe a general algorithm for inference and learning over hierarchical latent probabilistic models. Despite this,…

Machine Learning · Computer Science 2023-03-10 Umais Zahid , Qinghai Guo , Karl Friston , Zafeirios Fountas

The identification of the lag length for vector autoregressive models by mean of Akaike Information Criterion (AIC), Partial Autoregressive and Correlation Matrices (PAM and PCM hereafter) is studied in the framework of processes with time…

Methodology · Statistics 2013-08-27 Hamdi RaÏssi

A common problem in natural sciences is the comparison of competing models in the light of observed data. Bayesian model comparison provides a statistically sound framework for this comparison based on the evidence each model provides for…

Machine Learning · Statistics 2022-03-23 Jan Boelts

Given an autoregressive process X of order p (i.e. X_n = a_1 X_{n-1} + ...+ a_p X_{n_p} + Y_n where the random variables Y_1, Y_2, ... are i.i.d.), we study the asymptotic behaviour of the probability that the process does not exceed a…

Probability · Mathematics 2012-07-17 Christoph Baumgarten

Approximate Bayesian computation (ABC) methods provide an elaborate approach to Bayesian inference on complex models, including model choice. Both theoretical arguments and simulation experiments indicate, however, that model posterior…

Fractional Gaussian noise (fGn) is a self-similar stochastic process used to model anti-persistent or persistent dependency structures in observed time series. Properties of the autocovariance function of fGn are characterised by the Hurst…

Methodology · Statistics 2016-11-22 Sigrunn Holbek Sørbye , Håvard Rue

This paper considers the problem of semi-parametric proportional hazards model fitting for interval, left and right censored survival times. We adopt a more versatile penalized likelihood method to estimate the baseline hazard and the…

Methodology · Statistics 2019-04-16 Jun Ma , Dominique-Laurent Couturier , Stephane Heritier , Ian Marschner

Despite the excelling performance of machine learning models, understanding their decisions remains a long-standing goal. Although commonly used attribution methods from explainable AI attempt to address this issue, they typically rely on…

Machine Learning · Computer Science 2025-11-20 Juan Miguel Lopez Alcaraz , Nils Strodthoff

We posit that autoregressive flow models are well-suited to performing a range of causal inference tasks - ranging from causal discovery to making interventional and counterfactual predictions. In particular, we exploit the fact that…

Machine Learning · Statistics 2020-07-28 Ricardo Pio Monti , Ilyes Khemakhem , Aapo Hyvarinen

Model-based methods play a key role in the reconstruction of compressed sensing (CS) MRI. Finding an effective prior to describe the statistical distribution of the image family of interest is crucial for model-based methods. Plug-and-play…

Image and Video Processing · Electrical Eng. & Systems 2024-11-27 Tao Hong , Xiaojian Xu , Jason Hu , Jeffrey A. Fessler

Many Bayesian model selection problems, such as variable selection or cluster analysis, start by setting prior model probabilities on a structured model space. Based on a chosen loss function between models, model selection is often…

Methodology · Statistics 2023-11-23 Changwoo J. Lee

Simulation-based calibration (SBC) is a method for validating inference algorithms and model implementations through repeated inference on data simulated from a generative model. For a model to be generative, one must specify proper priors.…

Methodology · Statistics 2025-05-26 Luna Fazio , Maximilian Scholz , Javier Enrique Aguilar , Paul-Christian Bürkner

Structural causal models are the basic modelling unit in Pearl's causal theory; in principle they allow us to solve counterfactuals, which are at the top rung of the ladder of causation. But they often contain latent variables that limit…

Artificial Intelligence · Computer Science 2021-11-23 Marco Zaffalon , Alessandro Antonucci , Rafael Cabañas

We propose a penalized orthogonal-components regression (POCRE) for large p small n data. Orthogonal components are sequentially constructed to maximize, upon standardization, their correlation to the response residuals. A new penalization…

Methodology · Statistics 2013-04-18 Dabao Zhang , Yanzhu Lin , Min Zhang

Reinforcement learning algorithms rely on exploration to discover new behaviors, which is typically achieved by following a stochastic policy. In continuous control tasks, policies with a Gaussian distribution have been widely adopted.…

Machine Learning · Computer Science 2019-03-28 Dmytro Korenkevych , A. Rupam Mahmood , Gautham Vasan , James Bergstra

Understanding the time-varying structure of complex temporal systems is one of the main challenges of modern time series analysis. In this paper, we show that every uniformly-positive-definite-in-covariance and sufficiently short-range…

Statistics Theory · Mathematics 2023-04-25 Xiucai Ding , Zhou Zhou

We consider the strongly consistent question for model selection in a large class of causal time series models, including AR($\infty$), ARCH($\infty$), TARCH($\infty$), ARMA-GARCH and many classical others processes. We propose a penalized…

Statistics Theory · Mathematics 2020-08-21 William Kengne

Due to their uncertainty quantification, Bayesian solutions to inverse problems are the framework of choice in applications that are risk averse. These benefits come at the cost of computations that are in general, intractable. New advances…

Machine Learning · Computer Science 2024-05-10 Rafael Orozco , Ali Siahkoohi , Mathias Louboutin , Felix J. Herrmann

Reinforcement Learning with Verifiable Rewards (RLVR) has become the leading paradigm for enhancing reasoning in Large Language Models (LLMs). However, standard RLVR algorithms suffer from a well-documented pathology: while they improve…

Machine Learning · Computer Science 2026-02-26 Yuanda Xu , Hejian Sang , Zhengze Zhou , Ran He , Zhipeng Wang

This paper proposes a new algorithm for Gaussian process classification based on posterior linearisation (PL). In PL, a Gaussian approximation to the posterior density is obtained iteratively using the best possible linearisation of the…

Machine Learning · Computer Science 2019-04-19 Ángel F. García-Fernández , Filip Tronarp , Simo Särkkä