English
Related papers

Related papers: Optimal kernel selection for density estimation

200 papers

Kernel-based nonparametric hazard rate estimation is considered with a special class of infinite-order kernels that achieves favorable bias and mean square error properties. A fully automatic and adaptive implementation of a density and…

Statistics Theory · Mathematics 2018-10-17 Arthur Berg , Dimitris N Politis , Kagba Suaray , Hui Zeng

Anomaly detection based on one-class classification algorithms is broadly used in many applied domains like image processing (e.g. detection of whether a patient is "cancerous" or "healthy" from mammography image), network intrusion…

Machine Learning · Statistics 2017-07-14 Evgeny Burnaev , Pavel Erofeev , Dmitry Smolyakov

A well-recognized limitation of kernel learning is the requirement to handle a kernel matrix, whose size is quadratic in the number of training examples. Many methods have been proposed to reduce this computational cost, mostly by using a…

Machine Learning · Computer Science 2014-11-06 Nicolò Cesa-Bianchi , Yishay Mansour , Ohad Shamir

We prove rates of convergence in the statistical sense for kernel-based least squares regression using a conjugate gradient algorithm, where regularization against overfitting is obtained by early stopping. This method is directly related…

Statistics Theory · Mathematics 2010-09-30 Gilles Blanchard , Nicole Kraemer

We consider the problem of simultaneously learning to linearly combine a very large number of kernels and learn a good predictor based on the learnt kernel. When the number of kernels $d$ to be combined is very large, multiple kernel…

Machine Learning · Computer Science 2015-03-20 Arash Afkanpour , András György , Csaba Szepesvári , Michael Bowling

In this paper, we propose a special fusion method for combining ensembles of base classifiers utilizing new neural networks in order to improve overall efficiency of classification. While ensembles are designed such that each classifier is…

Machine Learning · Computer Science 2009-12-08 Mehdi Salkhordeh Haghighi , Hadi Sadoghi Yazdi , Abedin Vahedian , Hamed Modaghegh

In Computer Vision, problem of identifying or classifying the objects present in an image is called Object Categorization. It is a challenging problem, especially when the images have clutter background, occlusions or different lighting…

Computer Vision and Pattern Recognition · Computer Science 2016-04-26 Jyothi Korra

The main objective of the Multiple Kernel k-Means (MKKM) algorithm is to extract non-linear information and achieve optimal clustering by optimizing base kernel matrices. Current methods enhance information diversity and reduce redundancy…

Machine Learning · Computer Science 2024-03-07 Rina Su , Yu Guo , Caiying Wu , Qiyu Jin , Tieyong Zeng

The kernel least-mean-square (KLMS) algorithm is an appealing tool for online identification of nonlinear systems due to its simplicity and robustness. In addition to choosing a reproducing kernel and setting filter parameters, designing a…

Machine Learning · Statistics 2013-11-01 Jie Chen , Wei Gao , Cédric Richard , Jose-Carlos M. Bermudez

Kernel-based feature selection is an important tool in nonparametric statistics. Despite many practical applications of kernel-based feature selection, there is little statistical theory available to support the method. A core challenge is…

Statistics Theory · Mathematics 2022-05-26 Feng Ruan , Keli Liu , Michael I. Jordan

The strong-form asymmetric kernel-based collocation method, commonly referred to as the Kansa method, is easy to implement and hence is widely used for solving engineering problems and partial differential equations despite the lack of…

Numerical Analysis · Mathematics 2018-01-03 Ka-Chun Cheung , Leevan Ling , Robert Schaback

Motivated by applications, we consider here new operator theoretic approaches to Conditional mean embeddings (CME). Our present results combine a spectral analysis-based optimization scheme with the use of kernels, stochastic processes, and…

Machine Learning · Computer Science 2023-05-16 Palle E. T. Jorgensen , Myung-Sin Song , James Tian

Recent contributions have framed linear system identification as a nonparametric regularized inverse problem. Relying on $\ell_2$-type regularization which accounts for the stability and smoothness of the impulse response to be estimated,…

Systems and Control · Computer Science 2016-09-30 Giulia Prando , Gianluigi Pillonetto , Alessandro Chiuso

Asymmetric kernels naturally exist in real life, e.g., for conditional probability and directed graphs. However, most of the existing kernel-based learning methods require kernels to be symmetric, which prevents the use of asymmetric…

Machine Learning · Computer Science 2022-02-04 Mingzhen He , Fan He , Lei Shi , Xiaolin Huang , Johan A. K. Suykens

For two decades, reproducing kernels and their associated discrepancies have facilitated elegant theoretical analyses in the setting of quasi Monte Carlo. These same tools are now receiving interest in statistics and related fields, as…

Methodology · Statistics 2023-08-24 Chris. J. Oates

We introduce a novel kernel-based framework for learning differential equations and their solution maps that is efficient in data requirements, in terms of solution examples and amount of measurements from each example, and computational…

Machine Learning · Statistics 2025-04-07 Yasamin Jalalian , Juan Felipe Osorio Ramirez , Alexander Hsu , Bamdad Hosseini , Houman Owhadi

In the context of kernel density estimation, we give a characterization of the kernels for which the parametric mean integrated squared error rate $n^{-1}$ may be obtained, where $n$ is the sample size. Also, for the cases where this rate…

Statistics Theory · Mathematics 2011-11-22 J. E. Chacón , J. Montanero , A. G. Nogales

In this work, we study wavelet projection estimators for density estimation, focusing on their construction from $\mathcal{S}$-regular, compactly supported wavelet bases. A key aspect of such estimators is the choice of the resolution…

Statistics Theory · Mathematics 2025-09-10 Van Ha Hoang , Tien Dat Nguyen , Thi Mong Ngoc Nguyen

In this work, we broadly connect kernel-based filtering (e.g. approaches such as the bilateral filters and nonlocal means, but also many more) with general variational formulations of Bayesian regularized least squares, and the related…

Computer Vision and Pattern Recognition · Computer Science 2019-05-01 Frank Ong , Peyman Milanfar , Pascal Getreuer

Most blind deconvolution methods usually pre-define a large kernel size to guarantee the support domain. Blur kernel estimation error is likely to be introduced, yielding severe artifacts in deblurring results. In this paper, we first…

Computer Vision and Pattern Recognition · Computer Science 2019-02-25 Li Si-Yao , Dongwei Ren , Qian Yin
‹ Prev 1 4 5 6 7 8 10 Next ›