English
Related papers

Related papers: Penalizing complexity priors for Bayesian inferenc…

200 papers

Model Compression has drawn much attention within the deep learning community recently. Compressing a dense neural network offers many advantages including lower computation cost, deployability to devices of limited storage and memories,…

Machine Learning · Computer Science 2024-11-04 Diptarka Saha , Zihe Liu , Feng Liang

Bayesian priors offer a compact yet general means of incorporating domain knowledge into many learning tasks. The correctness of the Bayesian analysis and inference, however, largely depends on accuracy and correctness of these priors.…

Machine Learning · Computer Science 2012-02-20 Mahdi MIlani Fard , Joelle Pineau , Csaba Szepesvari

Bayesian inference promises a framework for principled uncertainty quantification of neural network predictions. Barriers to adoption include the difficulty of fully characterizing posterior distributions on network parameters and the…

Machine Learning · Statistics 2025-01-22 Katharine Fisher , Youssef Marzouk

Bayesian aggregation lets election forecasters combine diverse sources of information, such as state polls and economic and political indicators: as in our collaboration with The Economist magazine. However, the demands of real-time…

Methodology · Statistics 2025-10-23 Geonhee Han , Andrew Gelman , Aki Vehtari

Time series with multiple periodically correlated components is a complex problem with comparatively limited prior research. Most existing time series models are designed to accommodate simple periodically correlated components and tend to…

Methodology · Statistics 2025-09-29 Jie Yao , Kai Zhang , Eric Rose , Edward Valachovic

In many application areas, data are collected on a categorical response and high-dimensional categorical predictors, with the goals being to build a parsimonious model for classification while doing inferences on the important predictors.…

Methodology · Statistics 2013-01-22 Yun Yang , David B. Dunson

Power and sample size analysis comprises a critical component of clinical trial study design. There is an extensive collection of methods addressing this problem from diverse perspectives. The Bayesian paradigm, in particular, has attracted…

Methodology · Statistics 2021-12-08 Jane Pan , Sudipto Banerjee

The Bayesian approach to data analysis provides a powerful way to handle uncertainty in all observations, model parameters, and model structure using probability theory. Probabilistic programming languages make it easier to specify and fit…

Probabilistic model checking for systems with large or unbounded state space is a challenging computational problem in formal modelling and its applications. Numerical algorithms require an explicit representation of the state space, while…

Logic in Computer Science · Computer Science 2018-06-12 Dimitrios Milios , Guido Sanguinetti , David Schnoerr

As an alternative to variable selection or shrinkage in high dimensional regression, we propose to randomly compress the predictors prior to analysis. This dramatically reduces storage and computational bottlenecks, performing well when the…

Machine Learning · Statistics 2013-03-26 Rajarshi Guhaniyogi , David B. Dunson

This work addresses the problem of high-dimensional classification by exploring the generalized Bayesian logistic regression method under a sparsity-inducing prior distribution. The method involves utilizing a fractional power of the…

Statistics Theory · Mathematics 2024-03-20 The Tien Mai

A central characteristic of Bayesian statistics is the ability to consistently incorporate prior knowledge into various modeling processes. In this paper, we focus on translating domain expert knowledge into corresponding prior…

Methodology · Statistics 2024-04-16 Florence Bockting , Stefan T. Radev , Paul-Christian Bürkner

The Massively Parallel Computation (MPC) model serves as a common abstraction of many modern large-scale data processing frameworks, and has been receiving increasingly more attention over the past few years, especially in the context of…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-01-08 Danupon Nanongkai , Michele Scquizzato

Parameter estimation connects mathematical models to real-world data and decision making across many scientific and industrial applications. Standard approaches such as maximum likelihood estimation and Markov chain Monte Carlo estimate…

Methodology · Statistics 2026-02-06 Matthew J Simpson , James S Bennett , Alexander Johnston , Ruth E Baker

Determining how to appropriately select the tuning parameter is essential in penalized likelihood methods for high-dimensional data analysis. We examine this problem in the setting of penalized likelihood methods for generalized linear…

Methodology · Statistics 2016-05-12 Yingying Fan , Cheng Yong Tang

We develop a fast and accurate grouped penalized credible region approach for variable selection and prediction in Bayesian high-dimensional linear regression. Most existing Bayesian methods either are subject to high computational costs…

Methodology · Statistics 2026-01-26 Weichang Yu , Khue-Dung Dang

When dealing with Bayesian inference the choice of the prior often remains a debatable question. Empirical Bayes methods offer a data-driven solution to this problem by estimating the prior itself from an ensemble of data. In the…

Methodology · Statistics 2020-05-13 Ilja Klebanov , Alexander Sikorski , Christof Schütte , Susanna Röblitz

Predicting outcomes in external domains is challenging due to hidden confounders that potentially influence both predictors and outcomes. Well-established methods frequently rely on stringent assumptions, explicit knowledge about the…

Methodology · Statistics 2025-10-14 Carlos García Meixide , David Ríos Insua

This paper develops a distributed model predictive control (DMPC) strategy for a class of discrete-time linear systems with consideration of globally coupled constraints. The DMPC under study is based on the dual problem concerning all…

Optimization and Control · Mathematics 2019-07-25 Yanxu Su , Yang Shi , Changyin Sun

While the choice of prior is one of the most critical parts of the Bayesian inference workflow, recent Bayesian deep learning models have often fallen back on vague priors, such as standard Gaussians. In this review, we highlight the…

Machine Learning · Statistics 2022-03-21 Vincent Fortuin