English
Related papers

Related papers: Proximal nested sampling with data-driven priors f…

200 papers

Specifying a Bayesian prior is notoriously difficult for complex models such as neural networks. Reasoning about parameters is made challenging by the high-dimensionality and over-parameterization of the space. Priors that seem benign and…

Machine Learning · Statistics 2020-10-22 Eric Nalisnick , Jonathan Gordon , José Miguel Hernández-Lobato

We consider deep multivariate models for heterogeneous collections of random variables. In the context of computer vision, such collections may e.g. consist of images, segmentations, image attributes, and latent variables. When developing…

Machine Learning · Computer Science 2026-02-03 Dmitrij Schlesinger , Boris Flach , Alexander Shekhovtsov

In performing a Bayesian analysis of astronomical data, two difficult problems often emerge. First, in estimating the parameters of some model for the data, the resulting posterior distribution may be multimodal or exhibit pronounced…

Astrophysics · Physics 2010-01-11 Farhan Feroz , M. P. Hobson

This paper reviews recent developments in statistical structure learning; namely, Bayesian model reduction. Bayesian model reduction is a method for rapidly computing the evidence and parameters of probabilistic models that differ only in…

Methodology · Statistics 2019-10-15 Karl Friston , Thomas Parr , Peter Zeidman

Nonlinear Mixed effects models are hidden variables models that are widely used in many fields such as pharmacometrics. In such models, the distribution characteristics of hidden variables can be specified by including several parameters…

Methodology · Statistics 2021-10-19 Edouard Ollier

Models of physics beyond the Standard Model often contain a large number of parameters. These form a high-dimensional space that is computationally intractable to fully explore. Experimental constraints project onto a subspace of viable…

High Energy Physics - Theory · Physics 2022-01-05 Jacob Hollingsworth , Michael Ratz , Philip Tanedo , Daniel Whiteson

Neural networks have achieved remarkable performance across various problem domains, but their widespread applicability is hindered by inherent limitations such as overconfidence in predictions, lack of interpretability, and vulnerability…

Machine Learning · Statistics 2023-09-29 Julyan Arbel , Konstantinos Pitas , Mariia Vladimirova , Vincent Fortuin

Predicting outcomes in external domains is challenging due to hidden confounders that potentially influence both predictors and outcomes. Well-established methods frequently rely on stringent assumptions, explicit knowledge about the…

Methodology · Statistics 2025-10-14 Carlos García Meixide , David Ríos Insua

In this paper, we introduce a novel framework for combining scientific knowledge within physics-based models and recurrent neural networks to advance scientific discovery in many dynamical systems. We will first describe the use of outputs…

Machine Learning · Computer Science 2018-10-09 Xiaowei Jia , Anuj Karpatne , Jared Willard , Michael Steinbach , Jordan Read , Paul C Hanson , Hilary A Dugan , Vipin Kumar

Potts models, which can be used to analyze dependent observations on a lattice, have seen widespread application in a variety of areas, including statistical mechanics, neuroscience, and quantum computing. To address the intractability of…

Computation · Statistics 2021-10-15 Anirban Chakraborty , Matthias Katzfuss , Joseph Guinness

In this paper we show that there is a link between approximate Bayesian methods and prior robustness. We show that what is typically recognized as an approximation to the likelihood, either due to the simulated data as in the Approximate…

Methodology · Statistics 2020-04-03 Chaitanya Joshi , Fabrizio Ruggeri

Bayesian models quantify uncertainty and facilitate optimal decision-making in downstream applications. For most models, however, practitioners are forced to use approximate inference techniques that lead to sub-optimal decisions due to…

Machine Learning · Statistics 2019-09-12 Tomasz Kuśmierczyk , Joseph Sakaya , Arto Klami

Learning scientific document representations can be substantially improved through contrastive learning objectives, where the challenge lies in creating positive and negative training samples that encode the desired similarity semantics.…

Computation and Language · Computer Science 2022-10-20 Malte Ostendorff , Nils Rethmeier , Isabelle Augenstein , Bela Gipp , Georg Rehm

Multiscale modeling of complex systems is crucial for understanding their intricacies. Data-driven multiscale modeling has emerged as a promising approach to tackle challenges associated with complex systems. On the other hand,…

Machine Learning · Computer Science 2024-03-26 Ruyi Tao , Ningning Tao , Yi-zhuang You , Jiang Zhang

Ill-posed inverse problems are commonplace in biomedical image processing. Their solution typically requires imposing prior knowledge about the latent ground truth. While this regularizes the problem to an extent where it can be solved, it…

Computer Vision and Pattern Recognition · Computer Science 2014-09-05 Yuanhao Gong , Ivo F. Sbalzarini

The implicit convex feasibility problem attempts to find a point in the intersection of a finite family of convex sets, some of which are not explicitly determined but may vary. We develop simultaneous and sequential projection methods…

Optimization and Control · Mathematics 2016-06-21 Yair Censor , Aviv Gibali , Frank Lenzen , Christoph Schnorr

This is a preliminary version of visual interpretation integrating multiple sensors in SUCCESSOR, an intelligent, model-based vision system. We pursue a thorough integration of hierarchical Bayesian inference with comprehensive physical…

Artificial Intelligence · Computer Science 2013-04-11 Thomas O. Binford , Tod S. Levitt , Wallace B. Mann

Closed-form, interpretable mathematical models have been instrumental for advancing our understanding of the world; with the data revolution, we may now be in a position to uncover new such models for many systems from physics to the social…

Physics-based models of dynamical systems are often used to study engineering and environmental systems. Despite their extensive use, these models have several well-known limitations due to simplified representations of the physical…

Machine Learning · Computer Science 2020-09-15 Xiaowei Jia , Jared Willard , Anuj Karpatne , Jordan S Read , Jacob A Zwart , Michael Steinbach , Vipin Kumar

This work introduces the nested-set Hessian approximation, a second-order approximation method that can be used in any derivative-free optimization routine that requires such information. It is built on the foundation of the generalized…

Optimization and Control · Mathematics 2020-11-06 Warren Hare , Gabriel Jarry-Bolduc , Chayne Planiden