中文
相关论文

相关论文: Stabilised weighted data subsampling for accelerat…

200 篇论文

This paper introduces a framework for speeding up Bayesian inference conducted in presence of large datasets. We design a Markov chain whose transition kernel uses an (unknown) fraction of (fixed size) of the available data that is randomly…

统计方法学 · 统计学 2018-06-01 Florian Maire , Nial Friel , Pierre Alquier

In this paper, we consider static parameter estimation for a class of continuous-time state-space models. Our goal is to obtain an unbiased estimate of the gradient of the log-likelihood (score function), which is an estimate that is…

机器学习 · 统计学 2021-06-01 Marco Ballesio , Ajay Jasra

We present a new Subset Simulation approach using Hamiltonian neural network-based Monte Carlo sampling for reliability analysis. The proposed strategy combines the superior sampling of the Hamiltonian Monte Carlo method with…

We show that unconverged stochastic gradient descent can be interpreted as a procedure that samples from a nonparametric variational approximate posterior distribution. This distribution is implicitly defined as the transformation of an…

机器学习 · 统计学 2015-04-07 Dougal Maclaurin , David Duvenaud , Ryan P. Adams

Simulation-based inference has been popular for amortized Bayesian computation. It is typical to have more than one posterior approximation, from different inference algorithms, different architectures, or simply the randomness of…

统计方法学 · 统计学 2024-03-04 Yuling Yao , Bruno Régaldo-Saint Blancard , Justin Domke

Classification and probability estimation are fundamental tasks with broad applications across modern machine learning and data science, spanning fields such as biology, medicine, engineering, and computer science. Recent development of…

统计方法学 · 统计学 2026-03-25 Liyun Zeng , Hao Helen Zhang

This study presents an importance sampling formulation based on adaptively relaxing parameters from the indicator function and/or the probability density function. The formulation embodies the prevalent mathematical concept of relaxing a…

应用统计 · 统计学 2024-04-11 Jianhua Xian , Ziqi Wang

The debiased estimator is a crucial tool in statistical inference for high-dimensional model parameters. However, constructing such an estimator involves estimating the high-dimensional inverse Hessian matrix, incurring significant…

机器学习 · 统计学 2023-12-18 Jiyuan Tu , Weidong Liu , Xiaojun Mao , Mingyue Xu

In predictive modeling with simulation or machine learning, it is critical to accurately assess the quality of estimated values through output analysis. In recent decades output analysis has become enriched with methods that quantify the…

统计方法学 · 统计学 2023-10-27 Kimia Vahdat , Sara Shashaani

Predictions from machine learning algorithms can vary across random seeds, inducing instability in downstream debiased machine learning estimators. We formalize random seed stability via a concentration condition and prove that subbagging…

统计方法学 · 统计学 2026-04-21 Nicholas Williams , Alejandro Schuler

In modern data analysis, sparse model selection becomes inevitable once the number of predictors variables is very high. It is well-known that model selection procedures like the Lasso or Boosting tend to overfit on real data. The…

机器学习 · 计算机科学 2022-02-11 Tino Werner

Motivated by parametric models for which the likelihood is analytically unavailable, numerically unstable, or prohibitively expensive to compute or optimize, we develop a prior- and likelihood-free framework for fully probabilistic…

统计方法学 · 统计学 2026-03-17 Leonardo Cella , Emily C. Hector

How can we perform efficient inference and learning in directed probabilistic models, in the presence of continuous latent variables with intractable posterior distributions, and large datasets? We introduce a stochastic variational…

机器学习 · 统计学 2022-12-13 Diederik P Kingma , Max Welling

For massive data, the family of subsampling algorithms is popular to downsize the data volume and reduce computational burden. Existing studies focus on approximating the ordinary least squares estimate in linear regression, where…

统计计算 · 统计学 2019-06-27 HaiYing Wang , Rong Zhu , Ping Ma

Robust Bayesian inference using density power divergence (DPD) has emerged as a promising approach for handling outliers in statistical estimation. Although the DPD-based posterior offers theoretical guarantees of robustness, its practical…

统计方法学 · 统计学 2025-12-11 Naruki Sonobe , Tomotaka Momozaki , Tomoyuki Nakagawa

Bayesian parameter inference for complex stochastic simulators is challenging due to intractable likelihood functions. Existing simulation-based inference methods often require large number of simulations and become costly to use in…

机器学习 · 计算机科学 2026-04-06 Vasilis Gkolemis , Christos Diou , Michael U. Gutmann

As the use of machine learning in high impact domains becomes widespread, the importance of evaluating safety has increased. An important aspect of this is evaluating how robust a model is to changes in setting or population, which…

机器学习 · 计算机科学 2021-03-16 Adarsh Subbaswamy , Roy Adams , Suchi Saria

This paper addresses the challenge of model uncertainty in quantitative finance, where decisions in portfolio allocation, derivative pricing, and risk management rely on estimating stochastic models from limited data. In practice, the…

计算金融 · 定量金融 2025-06-10 Hans Buehler , Blanka Horvath , Yannick Limmer , Thorsten Schmidt

This paper tackles the challenge of parameter calibration in stochastic models, particularly in scenarios where the likelihood function is unavailable in an analytical form. We introduce a gradient-based simulated parameter estimation…

机器学习 · 统计学 2025-03-25 Zehao Li , Yijie Peng

We propose a robust inferential procedure for assessing uncertainties of parameter estimation in high-dimensional linear models, where the dimension $p$ can grow exponentially fast with the sample size $n$. Our method combines the…

机器学习 · 统计学 2015-03-19 Tianqi Zhao , Mladen Kolar , Han Liu