English
Related papers

Related papers: K$^2$IE: Kernel Method-based Kernel Intensity Esti…

200 papers

Given a statistical model, we propose a novel estimation method that yields randomised estimators for the unknown distribution of an observed random variable. We establish non-asymptotic bounds for the performance of these estimators and…

Statistics Theory · Mathematics 2026-05-06 Yannick Baraud

Instrumental variable (IV) regression is a strategy for learning causal relationships in observational data. If measurements of input X and output Y are confounded, the causal relationship can nonetheless be identified if an instrumental…

Machine Learning · Computer Science 2020-07-17 Rahul Singh , Maneesh Sahani , Arthur Gretton

The intensity of a Gibbs point process is usually an intractable function of the model parameters. For repulsive pairwise interaction point processes, this intensity can be expressed as the Laplace transform of some particular function.…

Methodology · Statistics 2017-12-11 Jean-François Coeurjolly , Frédéric Lavancier

Kernel methods provide a theoretically grounded framework for non-linear and non-parametric learning, with strong analytic foundations and statistical guarantees. Yet, their scalability has long been limited by prohibitive time and memory…

Machine Learning · Computer Science 2025-10-01 Maedeh Zarvandi , Michael Timothy , Theresa Wasserer , Debarghya Ghoshdastidar

Computing finite temperature properties of a quantum many-body system is key to describing a broad range of correlated quantum many-body physics from quantum chemistry and condensed matter to thermal quantum field theories. Quantum…

Quantum Physics · Physics 2023-08-16 Hai Wang , Jue Nan , Tao Zhang , Xingze Qiu , Wenlan Chen , Xiaopeng Li

Real-time density estimation is ubiquitous in many applications, including computer vision and signal processing. Kernel density estimation is arguably one of the most commonly used density estimation techniques, and the use of "sliding…

Machine Learning · Statistics 2023-11-13 Yinsong Wang , Yu Ding , Shahin Shahrampour

We combine K-means clustering with the least-squares kernel classification method. K-means clustering is used to extract a set of representative vectors for each class. The least-squares kernel method uses these representative vectors as a…

Machine Learning · Computer Science 2020-12-25 M. Andrecut

Accurate uncertainty quantification is a critical challenge in machine learning. While neural networks are highly versatile and capable of learning complex patterns, they often lack interpretability due to their ``black box'' nature. On the…

Machine Learning · Computer Science 2025-11-18 Pragatheeswaran Vipulananthan , Kamal Premaratne , Dilip Sarkar , Manohar N. Murthi

Intensity estimation is a common problem in statistical analysis of spatial point pattern data. This paper proposes a nonparametric Bayesian method for estimating the spatial point process intensity based on mixture of finite mixture (MFM)…

Methodology · Statistics 2019-07-09 Junxian Geng , Wei Shi , Guanyu Hu

A structure-preserving kernel ridge regression method is presented that allows the recovery of nonlinear Hamiltonian functions out of datasets made of noisy observations of Hamiltonian vector fields. The method proposes a closed-form…

Machine Learning · Statistics 2025-04-07 Jianyu Hu , Juan-Pablo Ortega , Daiying Yin

In this work, we introduce a new methodology for inferring the interaction structure of discrete valued time series which are Poisson distributed. While most related methods are premised on continuous state stochastic processes, in fact,…

Methodology · Statistics 2021-08-12 Jeremie Fish , Jie Sun , Erik Bollt

Current methods for stochastic hyperparameter learning in Gaussian Processes (GPs) rely on approximations, such as computing biased stochastic gradients or using inducing points in stochastic variational inference. However, when using such…

Machine Learning · Computer Science 2025-08-29 Neta Shoham , Haim Avron

Local polynomial regression of order at least one often performs poorly in regions of sparse data. Local constant regression is exceptional in this regard, though it is the least accurate method in general, especially at the boundaries of…

Methodology · Statistics 2024-06-18 Chunlei Ge , W. John Braun

This paper derives error bounds for regression in continuous time over subsets of certain types of Riemannian manifolds.The regression problem is typically driven by a nonlinear evolution law taking values on the manifold, and it is cast as…

Dynamical Systems · Mathematics 2022-09-09 Nathan Powell , Jia Guo , Sai Tej Parachuri , John Burns , Boone Estes , Andrew Kurdila

We propose a novel approach to parameter estimation for simulator-based statistical models with intractable likelihood. Our proposed method involves recursive application of kernel ABC and kernel herding to the same observed data. We…

Machine Learning · Statistics 2018-06-13 Takafumi Kajihara , Motonobu Kanagawa , Keisuke Yamazaki , Kenji Fukumizu

Inference in popular nonparametric Bayesian models typically relies on sampling or other approximations. This paper presents a general methodology for constructing novel tractable nonparametric Bayesian methods by applying the kernel trick…

Machine Learning · Statistics 2011-08-15 Ferenc Huszár , Simon Lacoste-Julien

Building highly non-linear and non-parametric models is central to several state-of-the-art machine learning systems. Kernel methods form an important class of techniques that induce a reproducing kernel Hilbert space (RKHS) for inferring…

Machine Learning · Statistics 2017-11-16 Huan Song , Jayaraman J. Thiagarajan , Prasanna Sattigeri , Andreas Spanias

Our purpose in this paper is to apply the general methodology for model selection based on T-estimators developed in Birg\'{e} [Ann. Inst. H. Poincar\'{e} Probab. Statist. 42 (2006) 273--325] to the particular situation of the estimation of…

Statistics Theory · Mathematics 2009-09-29 Lucien Birgé

We introduce the Kernel-Elastic Autoencoder (KAE), a self-supervised generative model based on the transformer architecture with enhanced performance for molecular design. KAE is formulated based on two novel loss functions: modified…

Machine Learning · Computer Science 2024-03-26 Haote Li , Yu Shee , Brandon Allen , Federica Maschietto , Victor Batista

Simulating the workload is an essential procedure in microservice systems as it helps augment realistic workloads whilst safeguarding user privacy. The efficacy of such simulation depends on its dynamic assessment. The straightforward and…

Software Engineering · Computer Science 2023-11-28 Pengsheng Li , Qingfeng Du , Shengjie Zhao