English
Related papers

Related papers: Copula-Stein Discrepancy: A Generator-Based Stein …

200 papers

Uncertain information on input parameters of reliability models is usually modeled by considering these parameters as random, and described by marginal distributions and a dependence structure of these variables. In numerous real-world…

Applications · Statistics 2018-04-30 Nazih Benoumechiara , Bertrand Michel , Philippe Saint-Pierre , Nicolas Bousquet

Being symmetric positive-definite (SPD), covariance matrix has traditionally been used to represent a set of local descriptors in visual recognition. Recent study shows that kernel matrix can give considerably better representation by…

Computer Vision and Pattern Recognition · Computer Science 2017-11-15 Melih Engin , Lei Wang , Luping Zhou , Xinwang Liu

In this paper, we report on a correctly scaling novel coupled cluster singles and doubles (CCSD) implementation for arbitrary high-spin open-shell states. The chosen cluster operator is completely spin-free, i.e. employs spatial…

Chemical Physics · Physics 2022-02-23 Nils Herrmann , Michael Hanrath

Nonparametric estimation of copula density functions using kernel estimators presents significant challenges. One issue is the potential unboundedness of certain copula density functions at the corners of the unit square. Another is the…

Methodology · Statistics 2025-02-11 Mathias N. Muia , Olivia Atutey , Mahmud Hasan

An important task in computational statistics and machine learning is to approximate a posterior distribution $p(x)$ with an empirical measure supported on a set of representative points $\{x_i\}_{i=1}^n$. This paper focuses on methods…

We enlarge the number of available functional depths by introducing the kernelized functional spatial depth (KFSD). KFSD is a local-oriented and kernel-based version of the recently proposed functional spatial depth (FSD) that may be useful…

Methodology · Statistics 2015-01-09 Carlo Sguera , Pedro Galeano , Rosa Lillo

Kernel based methods provide a way to reconstruct potentially high-dimensional functions from meshfree samples, i.e., sampling points and corresponding target values. A crucial ingredient for this to be successful is the distribution of the…

Numerical Analysis · Mathematics 2021-05-19 Tizian Wenzel , Gabriele Santin , Bernard Haasdonk

Gradient estimation -- approximating the gradient of an expectation with respect to the parameters of a distribution -- is central to the solution of many machine learning problems. However, when the distribution is discrete, most common…

Machine Learning · Statistics 2024-04-16 Jiaxin Shi , Yuhao Zhou , Jessica Hwang , Michalis K. Titsias , Lester Mackey

Every copula $ C $ for a random vector $ {\bf X}=(X_1,\dots,X_d) $ with identically distributed coordinates determines a unique copula $ C_{:d} $ for its order statistic $ {\bf X}_{:d}=(X_{1:d},\dots,X_{d:d}) $. In the present paper we…

Probability · Mathematics 2018-08-06 Sebastian Fuchs , Klaus D. Schmidt

Distributed Stein Variational Gradient Descent (DSVGD) is a non-parametric distributed learning framework for federated Bayesian learning, where multiple clients jointly train a machine learning model by communicating a number of non-random…

Machine Learning · Computer Science 2023-03-14 Jiarong Yang , Yuan Liu , Rahif Kassab

Stein variational gradient descent (SVGD) is a deterministic particle inference algorithm that provides an efficient alternative to Markov chain Monte Carlo. However, SVGD has been found to suffer from variance underestimation when the…

Machine Learning · Statistics 2022-03-14 Xing Liu , Harrison Zhu , Jean-François Ton , George Wynne , Andrew Duncan

We study the Stochastic Gradient Descent (SGD) algorithm in nonparametric statistics: kernel regression in particular. The directional bias property of SGD, which is known in the linear regression setting, is generalized to the kernel…

Machine Learning · Statistics 2022-08-30 Yiling Luo , Xiaoming Huo , Yajun Mei

We present a new method for evaluating and training unnormalized density models. Our approach only requires access to the gradient of the unnormalized model's log-density. We estimate the Stein discrepancy between the data density $p(x)$…

Machine Learning · Statistics 2020-08-17 Will Grathwohl , Kuan-Chieh Wang , Jorn-Henrik Jacobsen , David Duvenaud , Richard Zemel

Stein importance sampling is a widely applicable technique based on kernelized Stein discrepancy, which corrects the output of approximate sampling algorithms by reweighting the empirical distribution of the samples. A general analysis of…

Statistics Theory · Mathematics 2021-09-14 Liam Hodgkinson , Robert Salomone , Fred Roosta

Algebraic topology methods have recently played an important role for statistical analysis with complicated geometric structured data such as shapes, linked twist maps, and material data. Among them, \textit{persistent homology} is a…

Machine Learning · Statistics 2018-10-30 Tam Le , Makoto Yamada

The original development of Shapley values for prediction explanation relied on the assumption that the features being described were independent. If the features in reality are dependent this may lead to incorrect explanations. Hence,…

Methodology · Statistics 2021-02-15 Kjersti Aas , Thomas Nagler , Martin Jullum , Anders Løland

We are interested in a framework of online learning with kernels for low-dimensional but large-scale and potentially adversarial datasets. We study the computational and theoretical performance of online variations of kernel Ridge…

Machine Learning · Statistics 2019-05-30 Rémi Jézéquel , Pierre Gaillard , Alessandro Rudi

Dataset distillation (DD) aims to compress large-scale datasets into compact synthetic counterparts for efficient model training. However, existing DD methods exhibit substantial performance degradation on long-tailed datasets. We identify…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Ruixi Wu , Shaobo Wang , Jiahuan Chen , Zhiyuan Liu , Yicun Yang , Zhaorun Chen , Zekai Li , Kaixin Li , Xinming Wang , Hongzhu Yi , Kai Wang , Linfeng Zhang

This paper introduces a nonparametric copula-based index for detecting the strength and monotonicity structure of linear and nonlinear statistical dependence between pairs of random variables or stochastic signals. Our index, termed Copula…

Machine Learning · Statistics 2020-02-25 Kiran Karra , Lamine Mili

We investigate the discrepancy principle for choosing smoothing parameters for kernel density estimation. The method is based on the distance between the empirical and estimated distribution functions. We prove some new positive and…

Statistics Theory · Mathematics 2015-03-19 Thoralf Mildenberger