中文
相关论文

相关论文: Projected Stein Variational Newton: A Fast and Sca…

200 篇论文

We introduce a principal support vector machine (PSVM) approach that can be used for both linear and nonlinear sufficient dimension reduction. The basic idea is to divide the response variables into slices and use a modified form of support…

统计理论 · 数学 2012-03-14 Bing Li , Andreas Artemiou , Lexin Li

We propose an efficient way to sample from a class of structured multivariate Gaussian distributions which routinely arise as conditional posteriors of model parameters that are assigned a conditionally Gaussian prior. The proposed…

统计计算 · 统计学 2016-06-28 Anirban Bhattacharya , Antik Chakraborty , Bani K. Mallick

We consider the problem of projecting a vector onto the so-called k-capped simplex, which is a hyper-cube cut by a hyperplane. For an n-dimensional input vector with bounded elements, we found that a simple algorithm based on Newton's…

最优化与控制 · 数学 2025-02-25 Andersen Ang , Jianzhu Ma , Nianjun Liu , Kun Huang , Yijie Wang

Sparse variational approximations allow for principled and scalable inference in Gaussian Process (GP) models. In settings where several GPs are part of the generative model, theses GPs are a posteriori coupled. For many applications such…

机器学习 · 统计学 2017-11-30 Vincent Adam

Convolutional Neural Networks (CNNs) are the predominant model used for a variety of medical image analysis tasks. At inference time, these models are computationally intensive, especially with volumetric data. In principle, it is possible…

计算机视觉与模式识别 · 计算机科学 2023-06-30 Jose Javier Gonzalez Ortiz , John Guttag , Adrian Dalca

The paper addresses joint sparsity selection in the regression coefficient matrix and the error precision (inverse covariance) matrix for high-dimensional multivariate regression models in the Bayesian paradigm. The selected sparsity…

统计方法学 · 统计学 2022-01-19 Srijata Samanta , Kshitij Khare , George Michailidis

In this article, we propose new Bayesian methods for selecting and estimating a sparse coefficient vector for skewed heteroscedastic response. Our novel Bayesian procedures effectively estimate the median and other quantile functions,…

统计方法学 · 统计学 2017-07-04 Libo Wang , Yuanyuan Tang , Debajyoti Sinha , Debdeep Pati , Stuart Lipsitz

Gaussian Process Motion Planning (GPMP) is a widely used framework for generating smooth trajectories within a limited compute time--an essential requirement in many robotic applications. However, traditional GPMP approaches often struggle…

机器人学 · 计算机科学 2025-04-08 Jiayun Li , Kay Pompetzki , An Thai Le , Haolei Tong , Jan Peters , Georgia Chalvatzaki

Our article considers a Gaussian variational approximation of the posterior density in a high-dimensional state space model. The variational parameters to be optimized are the mean vector and the covariance matrix of the approximation. The…

统计方法学 · 统计学 2020-02-20 Matias Quiroz , David J. Nott , Robert Kohn

This paper proposes a fast two-stage variational Bayesian (VB) algorithm to estimate unrestricted panel spatial autoregressive models. Using Dirichlet-Laplace priors, we are able to uncover the spatial relationships between cross-sectional…

计量经济学 · 经济学 2023-08-23 Deborah Gefang , Stephen G. Hall , George S. Tavlas

Over the past 10 years Bayesian methods have rapidly grown more popular as several computationally intensive statistical algorithms have become feasible with increased computer power. In this paper, we begin with a general description of…

天体物理学 · 物理学 2016-02-19 David A. van Dyk , Alanna Connors , Vinay L. Kashyap , Aneta Siemiginowska

Volume-preserving hyperelastic materials are widely used to model near-incompressible materials such as rubber and soft tissues. However, the numerical simulation of volume-preserving hyperelastic materials is notoriously challenging within…

图形学 · 计算机科学 2024-06-25 Honglin Chen , Hsueh-Ti Derek Liu , David I. W. Levin , Changxi Zheng , Alec Jacobson

We develop Bayesian predictive stacking for geostatistical models, where the primary inferential objective is to provide inference on the latent spatial random field and conduct spatial predictions at arbitrary locations. We exploit…

统计方法学 · 统计学 2025-09-25 Lu Zhang , Wenpin Tang , Sudipto Banerjee

Stein Variational Gradient Descent (SVGD) is a highly efficient method to sample from an unnormalized probability distribution. However, the SVGD update relies on gradients of the log-density, which may not always be available. Existing…

机器学习 · 计算机科学 2026-03-13 Cornelius V. Braun , Robert T. Lange , Marc Toussaint

interpretable, and well understood models that are routinely employed even though, as is revealed through prior and posterior predictive checks, these can poorly characterise the spatial heterogeneity in the underlying process of interest.…

Efficient index structures for fast approximate nearest neighbor queries are required in many applications such as recommendation systems. In high-dimensional spaces, many conventional methods suffer from excessive usage of memory and slow…

We introduce a new variational inference (VI) framework, called energetic variational inference (EVI). It minimizes the VI objective function based on a prescribed energy-dissipation law. Using the EVI framework, we can derive many existing…

机器学习 · 统计学 2026-05-12 Yiwei Wang , Jiuhai Chen , Chun Liu , Lulu Kang

Variational inference offers scalable and flexible tools to tackle intractable Bayesian inference of modern statistical models like Bayesian neural networks and Gaussian processes. For largely over-parameterized models, however, the…

机器学习 · 统计学 2019-12-03 Simone Rossi , Sebastien Marmin , Maurizio Filippone

We present two new remarkably simple stochastic second-order methods for minimizing the average of a very large number of sufficiently smooth and strongly convex functions. The first is a stochastic variant of Newton's method (SN), and the…

机器学习 · 计算机科学 2019-12-04 Dmitry Kovalev , Konstantin Mishchenko , Peter Richtárik

We study the parameter estimation problem for a varying index coefficient model in high dimensions. Unlike the most existing works that iteratively estimate the parameters and link functions, based on the generalized Stein's identity, we…

机器学习 · 统计学 2019-10-29 Sen Na , Zhuoran Yang , Zhaoran Wang , Mladen Kolar