English
Related papers

Related papers: Minimum Distance Summaries for Robust Neural Poste…

200 papers

Minimum distance estimation (MDE) gained recent attention as a formulation of (implicit) generative modeling. It considers minimizing, over model parameters, a statistical distance between the empirical data distribution and the model. This…

Statistics Theory · Mathematics 2020-10-21 Ziv Goldfeld , Kristjan Greenewald , Kengo Kato

Data-driven optimization of sampling patterns in MRI has recently received a significant attention.Following recent observations on the combinatorial number of minimizers in off-the-grid optimization, we propose a framework to globally…

Signal Processing · Electrical Eng. & Systems 2023-06-21 Alban Gossard , Frédéric de Gournay , Pierre Weiss

As models of cognition grow in complexity and number of parameters, Bayesian inference with standard methods can become intractable, especially when the data-generating model is of unknown analytic form. Recent advances in simulation-based…

Machine Learning · Statistics 2020-07-14 Stefan T. Radev , Andreas Voss , Eva Marie Wieschen , Paul-Christian Bürkner

Simulation-based inference (SBI) methods tackle complex scientific models with challenging inverse problems. However, SBI models often face a significant hurdle due to their non-differentiable nature, which hampers the use of gradient-based…

Machine Learning · Computer Science 2023-06-29 Vincent D. Zaballa , Elliot E. Hui

Neural networks are fragile when confronted with data that significantly deviates from their training distribution. This is true in particular for simulation-based inference methods, such as neural amortized Bayesian inference (ABI), where…

Detached eclipsing binaries (DEBs) enable direct inference of stellar and orbital properties across diverse stellar populations. However, inference typically requires computationally intensive forward modeling and radial velocity (RV)…

Solar and Stellar Astrophysics · Physics 2026-04-23 Jacqueline Blaum Hough , Joshua S. Bloom

Mechanistic models of single-neuron dynamics have been extensively studied in computational neuroscience. However, identifying which models can quantitatively reproduce empirically measured data has been challenging. We propose to overcome…

Stochastic infectious disease models capture uncertainty in public health outcomes and have become increasingly popular in epidemiological practice. However, calibrating these models to observed data is challenging with existing methods for…

Methodology · Statistics 2024-12-18 Prayag Chatha , Fan Bu , Jeffrey Regier , Evan Snitkin , Jon Zelner

Bayesian inference allows us to define a posterior distribution over the weights of a generic neural network (NN). Exact posteriors are usually intractable, in which case approximations can be employed. One such approximation - variational…

Machine Learning · Computer Science 2026-01-30 Andrew Millard , Joshua Murphy , Peter Green , Simon Maskell

Approximate Bayesian Computation is a family of likelihood-free inference techniques that are well-suited to models defined in terms of a stochastic generating mechanism. In a nutshell, Approximate Bayesian Computation proceeds by computing…

Computation · Statistics 2010-07-28 Michael Blum

In Bayesian inference prior hyperparameters are chosen subjectively or estimated using empirical Bayes methods. Generalised Bayesian Inference (GBI) also has a learning rate hyperparameter. This is compounded in Semi-Modular Inference…

Stochastic gradient descent (SGD) is perhaps the most prevalent optimization method in modern machine learning. Contrary to the empirical practice of sampling from the datasets without replacement and with (possible) reshuffling at each…

Optimization and Control · Mathematics 2024-02-08 Xufeng Cai , Cheuk Yin Lin , Jelena Diakonikolas

Neural networks are popular state-of-the-art models for many different tasks.They are often trained via back-propagation to find a value of the weights that correctly predicts the observed data. Although back-propagation has shown good…

Machine Learning · Statistics 2020-12-29 Simón Rodríguez Santana , Daniel Hernández-Lobato

For many practical applications in wireless communications, we need to recover a structured sparse signal from a linear observation model with dynamic grid parameters in the sensing matrix. Conventional expectation maximization (EM)-based…

Signal Processing · Electrical Eng. & Systems 2023-11-14 Wenkang Xu , An Liu , Bingpeng Zhou , Minjian Zhao

Spiking Neural Networks (SNNs) offer an energy efficient alternative to conventional Artificial Neural Networks (ANNs) but typically still require a large number of parameters. This work introduces Linearized Bregman Iterations (LBI) as an…

Signal Processing · Electrical Eng. & Systems 2026-03-18 Daniel Windhager , Bernhard A. Moser , Michael Lunglmayr

Model parameter inference is a universal problem across science. This challenge is particularly pronounced in developmental biology, where faithful mechanistic descriptions require spatial-stochastic models with numerous parameters, yet…

Biological Physics · Physics 2024-07-16 Michael A. Ramirez-Sierra , Thomas R. Sokolowski

Simulation-based inference (SBI) enables cosmological parameter estimation when closed-form likelihoods or models are unavailable. However, SBI relies on machine learning for neural compression and density estimation. This requires large…

Cosmology and Nongalactic Astrophysics · Physics 2025-09-29 Alex A. Saoulis , Davide Piras , Niall Jeffrey , Alessio Spurio Mancini , Ana M. G. Ferreira , Benjamin Joachimi

Simulation-based inference has been popular for amortized Bayesian computation. It is typical to have more than one posterior approximation, from different inference algorithms, different architectures, or simply the randomness of…

Methodology · Statistics 2024-03-04 Yuling Yao , Bruno Régaldo-Saint Blancard , Justin Domke

Approximate Bayesian Computation (ABC) is a framework for performing likelihood-free posterior inference for simulation models. Stochastic Variational inference (SVI) is an appealing alternative to the inefficient sampling approaches…

Machine Learning · Statistics 2016-06-29 Alexander Moreno , Tameem Adel , Edward Meeds , James M. Rehg , Max Welling

Traditionally, weak lensing cosmological surveys have been analyzed using summary statistics motivated by their analytically tractable likelihoods, or by their ability to access higher-order information, at the cost of requiring…

Cosmology and Nongalactic Astrophysics · Physics 2025-05-21 Denise Lanzieri , Justine Zeghal , T. Lucas Makinen , Alexandre Boucaud , Jean-Luc Starck , François Lanusse