English
Related papers

Related papers: Post Selection Inference with Kernels

200 papers

Parameterizing the approximate posterior of a generative model with neural networks has become a common theme in recent machine learning research. While providing appealing flexibility, this approach makes it difficult to impose or assess…

Machine Learning · Computer Science 2018-11-30 Romain Lopez , Jeffrey Regier , Michael I. Jordan , Nir Yosef

This study introduces a novel nonparametric approach for detecting Differential Item Functioning (DIF) in binary items through direct comparison of Item Response Curves (IRCs). Building on prior work on nonparametric comparison of…

Methodology · Statistics 2025-11-25 Adéla Hladká , Patrícia Martinková

In a general context of positive definite kernels $k$, we develop tools and algorithms for sampling in reproducing kernel Hilbert space $\mathscr{H}$ (RKHS). With reference to these RKHSs, our results allow inference from samples; more…

Functional Analysis · Mathematics 2016-01-28 Palle Jorgensen , Feng Tian

We present a probabilistic framework for both (i) determining the initial settings of kernel adaptive filters (KAFs) and (ii) constructing fully-adaptive KAFs whereby in addition to weights and dictionaries, kernel parameters are learnt…

Machine Learning · Statistics 2017-07-21 Iván Castro , Cristóbal Silva , Felipe Tobar

Recently, the importance of analysing data and collecting valuable insight efficiently has been increasing in various fields. Estimating mutual information (MI) plays a critical role to investigate the relationship among multiple random…

Quantum Physics · Physics 2025-03-10 Yota Maeda , Hideaki Kawaguchi , Hiroyuki Tezuka

In machine learning, the performance of a classifier depends on both the classifier model and the separability/complexity of datasets. To quantitatively measure the separability of datasets, we create an intrinsic measure -- the…

Machine Learning · Computer Science 2021-09-14 Shuyue Guan , Murray Loew

Independence testing is a classical statistical problem that has been extensively studied in the batch setting when one fixes the sample size before collecting data. However, practitioners often prefer procedures that adapt to the…

Machine Learning · Statistics 2025-05-21 Aleksandr Podkopaev , Patrick Blöbaum , Shiva Prasad Kasiviswanathan , Aaditya Ramdas

Gaussian processes (GPs) are powerful probabilistic models that define flexible priors over functions, offering strong interpretability and uncertainty quantification. However, GP models often rely on simple, stationary kernels which can…

Machine Learning · Computer Science 2025-05-20 Nima Negarandeh , Carlos Mora , Ramin Bostanabad

This paper presents a new perspective on the identification at infinity for the intercept of the sample selection model as identification at the boundary via a transformation of the selection index. This perspective suggests generalizations…

Econometrics · Economics 2023-02-13 Zhewen Pan

In this paper, based on the coupled social networks (CSN), we propose a hybrid algorithm to nonlinearly integrate both social and behavior information of online users. Filtering algorithm based on the coupled social networks, which…

Social and Information Networks · Computer Science 2015-06-19 Da-Cheng Nie , Zi-Ke Zhang , Jun-lin Zhou , Yan Fu , Kui Zhang

Kernel methods provide a flexible and theoretically grounded approach to nonlinear and nonparametric learning. While memory and run-time requirements hinder their applicability to large datasets, many low-rank kernel approximations, such as…

Machine Learning · Statistics 2024-04-15 Mateus P. Otto , Rafael Izbicki

Conditional independence is a fundamental concept in many areas of statistical research, including, for example, sufficient dimension reduction, causal inference, and statistical graphical models. In many modern applications, data arise in…

Methodology · Statistics 2026-03-17 Yin Tang , Bing Li

The classification of high dimensional data with kernel methods is considered in this article. Exploit- ing the emptiness property of high dimensional spaces, a kernel based on the Mahalanobis distance is proposed. The computation of the…

Numerical Analysis · Computer Science 2012-09-11 M. Fauvel , A. Villa , J. Chanussot , J. A. Benediktsson

An exploit of the Sequential Importance Sampling (SIS) algorithm using Differential Algebra (DA) techniques is derived to develop an efficient particle filter. The filter creates an original kind of particles, called scout particles, that…

Information Theory · Computer Science 2024-08-21 Simone Servadio

This paper presents a spike-based model which employs neurons with functionally distinct dendritic compartments for classifying high dimensional binary patterns. The synaptic inputs arriving on each dendritic subunit are nonlinearly…

Neural and Evolutionary Computing · Computer Science 2014-11-26 Shaista Hussain , Shih-Chii Liu , Arindam Basu

By removing irrelevant and redundant features, feature selection aims to find a good representation of the original features. With the prevalence of unlabeled data, unsupervised feature selection has been proven effective in alleviating the…

Machine Learning · Computer Science 2024-03-25 Ziyuan Lin , Deanna Needell

In the regression model $Y = b(X) +\sigma(X)\varepsilon$, where $X$ has a density $f$, this paper deals with an oracle inequality for an estimator of $bf$, involving a kernel in the sense of Lerasle et al. (2016), selected via the PCO…

Statistics Theory · Mathematics 2021-06-07 Hélène Halconruy , Nicolas Marie

Although a vast body of literature relates to image segmentation methods that use deep neural networks (DNNs), less attention has been paid to assessing the statistical reliability of segmentation results. In this study, we interpret the…

Machine Learning · Statistics 2022-12-15 Vo Nguyen Le Duy , Shogo Iwazaki , Ichiro Takeuchi

Numerous practical medical problems often involve data that possess a combination of both sparse and non-sparse structures. Traditional penalized regularizations techniques, primarily designed for promoting sparsity, are inadequate to…

Methodology · Statistics 2023-11-10 Shun Yu , Yuehan Yang

Discovering statistically significant patterns from databases is an important challenging problem. The main obstacle of this problem is in the difficulty of taking into account the selection bias, i.e., the bias arising from the fact that…

Machine Learning · Statistics 2016-03-10 Shinya Suzumura , Kazuya Nakagawa , Mahito Sugiyama , Koji Tsuda , Ichiro Takeuchi