English
Related papers

Related papers: Monotonicity preservation properties of kernel reg…

200 papers

This paper considers extensions of minimum-disparity estimators to the problem of estimating parameters in a regression model that is conditionally specified; that is where a parametric model describes the distribution of a response $y$…

Statistics Theory · Mathematics 2016-02-10 Giles Hooker

Topological data analysis and its main method, persistent homology, provide a toolkit for computing topological information of high-dimensional and noisy data sets. Kernels for one-parameter persistent homology have been established to…

Machine Learning · Computer Science 2019-06-06 René Corbet , Ulderico Fugacci , Michael Kerber , Claudia Landi , Bei Wang

Several variations of the Watterson estimator of variability for Next Generation Sequencing (NGS) data have been proposed in the literature. We present a unified framework for generalized Watterson estimators based on Maximum Composite…

Populations and Evolution · Quantitative Biology 2015-09-22 Luca Ferretti , Sebástian E. Ramos-Onsins

The aim of the present work is a comparative study of different persistence kernels applied to various classification problems. After some necessary preliminaries on homology and persistence diagrams, we introduce five different kernels…

Machine Learning · Computer Science 2024-08-15 Cinzia Bandiziol , Stefano De Marchi

In the regression model $Y = b(X) +\sigma(X)\varepsilon$, where $X$ has a density $f$, this paper deals with an oracle inequality for an estimator of $bf$, involving a kernel in the sense of Lerasle et al. (2016), selected via the PCO…

Statistics Theory · Mathematics 2021-06-07 Hélène Halconruy , Nicolas Marie

Topological data analysis is an emerging mathematical concept for characterizing shapes in multi-scale data. In this field, persistence diagrams are widely used as a descriptor of the input data, and can distinguish robust and noisy…

Machine Learning · Statistics 2017-06-13 Genki Kusano , Kenji Fukumizu , Yasuaki Hiraoka

This paper studies the consistency of the kernel-based neural ranking model K-NRM, a recent state-of-the-art neural IR model, which is important for reproducible research and deployment in the industry. We find that K-NRM has low variance…

Information Retrieval · Computer Science 2018-09-28 Mary Arpita Pyreddy , Varshini Ramaseshan , Narendra Nath Joshi , Zhuyun Dai , Chenyan Xiong , Jamie Callan , Zhiyuan Liu

The property of learning-curve monotonicity, highlighted in a recent series of work by Loog, Mey and Viering, describes algorithms which only improve in average performance given more data, for any underlying data distribution within a…

Statistics Theory · Mathematics 2025-12-29 Mark Sellke , Steven Yin

In regression problems where covariates are naturally organized in a hierarchical tree structure, a central challenge is to select the resolution at which covariates enter the model. Determining this level of feature aggregation is of…

Methodology · Statistics 2026-05-29 Sithija Manage , Y. Samuel Wang , Martin T. Wells

Three important properties of a classification machinery are: (i) the system preserves the core information of the input data; (ii) the training examples convey information about unseen data; and (iii) the system is able to treat…

Neural and Evolutionary Computing · Computer Science 2016-06-29 Raja Giryes , Guillermo Sapiro , Alex M. Bronstein

In this article, basing on NQD samples, we investigate the fixed design nonparametric regression model, where the errors are pairwise NQD random errors, with fixed design points, and an unknown function. Nonparametric weighted estimator…

Statistics Theory · Mathematics 2013-12-04 Jian-hua Shi , Xiao-ping Chen , Yong Zhou

Topological data analysis (TDA) is an emerging mathematical concept for characterizing shapes in complex data. In TDA, persistence diagrams are widely recognized as a useful descriptor of data, and can distinguish robust and noisy…

Algebraic Topology · Mathematics 2016-04-27 Genki Kusano , Kenji Fukumizu , Yasuaki Hiraoka

Given an i.i.d sample $(Y_i,Z_i)$, taking values in $\RRR^{d'}\times \RRR^d$, we consider a collection Nadarya-Watson kernel estimators of the conditional expectations $\EEE(<c_g(z),g(Y)>+d_g(z)\mid Z=z)$, where $z$ belongs to a compact set…

Statistics Theory · Mathematics 2012-01-27 Davit Varron , Ingrid Van Keilegom

Monotone operator equilibrium networks are implicit-layer models whose output is the unique equilibrium of a monotone operator, guaranteeing existence, uniqueness, and convergence. When deployed on low-precision hardware, weights are…

Optimization and Control · Mathematics 2026-03-12 James Li , Philip H. W. Leong , Thomas Chaffey

Quantum one-class support vector machines leverage the advantage of quantum kernel methods for semi-supervised anomaly detection. However, their quadratic time complexity with respect to data size poses challenges when dealing with large…

We adress the problem of consistency of the $k$-nearest neighbors kernel estimators of the density and the regression function in the multivariate case. We get the rates of strong uniform consistency on the whole space $\mathbb{R}^p$ for…

Statistics Theory · Mathematics 2024-08-26 Luran Bengono Mintogo , Emmanuel de Dieu Nkou , Guy Martial Nkiet

The Kaplan--Meier (KM) estimator, which provides a nonparametric estimate of a survival function for time-to-event data, has wide application in clinical studies, engineering, economics and other fields. The theoretical properties of the KM…

Methodology · Statistics 2020-11-23 Jiaqi Gu , Yiwei Fan , Guosheng Yin

We develop an adaptive monotone shrinkage estimator for regression models with the following characteristics: i) dense coefficients with small but important effects; ii) a priori ordering that indicates the probable predictive importance of…

Methodology · Statistics 2015-05-08 Zhuang Ma , Dean Foster , Robert Stine

We study nonparametric regression and classification for path-valued data. We introduce a functional Nadaraya-Watson estimator that combines the signature transform from rough path theory with local kernel regression. The signature…

Machine Learning · Statistics 2025-10-21 Christian Bayer , Davit Gogolashvili , Luca Pelizzari

There has been a surge of interest in developing robust estimators for models with heavy-tailed and bounded variance data in statistics and machine learning, while few works impose unbounded variance. This paper proposes two type of robust…

Machine Learning · Statistics 2022-10-12 Lihu Xu , Fang Yao , Qiuran Yao , Huiming Zhang