English
Related papers

Related papers: Local Quasi-Exponential Growth Models: Kernel Diff…

200 papers

Sparse manifold learning algorithms combine techniques in manifold learning and sparse optimization to learn features that could be utilized for downstream tasks. The standard setting of compressive sensing can not be immediately applied to…

Signal Processing · Electrical Eng. & Systems 2024-08-05 Abiy Tasissa , Pranay Tankala , Demba Ba

We propose a generalization of the linear panel quantile regression model to accommodate both \textit{sparse} and \textit{dense} parts: sparse means while the number of covariates available is large, potentially only a much smaller number…

Econometrics · Economics 2022-08-24 Alexandre Belloni , Mingli Chen , Oscar Hernan Madrid Padilla , Zixuan , Wang

Locally adapted parameterizations of a model (such as locally weighted regression) are expressive but often suffer from high variance. We describe an approach for reducing the variance, based on the idea of estimating simultaneously a…

Machine Learning · Computer Science 2012-07-03 Doina Precup , Philip Bachman

Fisher's linear discriminant analysis is a classical method for classification, yet it is limited to capturing linear features only. Kernel discriminant analysis as an extension is known to successfully alleviate the limitation through a…

Machine Learning · Statistics 2022-07-29 Jiae Kim , Yoonkyung Lee , Zhiyu Liang

Training neural network models with discrete (categorical or structured) latent variables can be computationally challenging, due to the need for marginalization over large or combinatorial sets. To circumvent this issue, one typically…

Machine Learning · Computer Science 2020-12-29 Gonçalo M. Correia , Vlad Niculae , Wilker Aziz , André F. T. Martins

For supervised classification problems, this paper considers estimating the query's label probability through local regression using observed covariates. Well-known nonparametric kernel smoother and $k$-nearest neighbor ($k$-NN) estimator,…

Machine Learning · Statistics 2022-07-25 Ruixing Cao , Akifumi Okuno , Kei Nakagawa , Hidetoshi Shimodaira

The generation of curves and surfaces from given data is a well-known problem in Computer-Aided Design that can be approached using subdivision schemes. They are powerful tools that allow obtaining new data from the initial one by means of…

Numerical Analysis · Mathematics 2024-12-03 Sergio López-Ureña , Dionisio F. Yáñez

We present a local density estimator based on first order statistics. To estimate the density at a point, $x$, the original sample is divided into subsets and the average minimum sample distance to $x$ over all such subsets is used to…

Methodology · Statistics 2014-12-10 Vikram V. Garg , Luis Tenorio , Karen Willcox

Non-interactive Local Differential Privacy (LDP) requires data analysts to collect data from users through noisy channel at once. In this paper, we extend the frontiers of Non-interactive LDP learning and estimation from several aspects.…

Machine Learning · Computer Science 2017-06-13 Kai Zheng , Wenlong Mou , Liwei Wang

A continuing challenge for machine learning is providing methods to perform computation on data while ensuring the data remains private. In this paper we build on the provable privacy guarantees of differential privacy which has been…

Machine Learning · Computer Science 2019-09-23 Michael Thomas Smith , Mauricio A. Alvarez , Neil D. Lawrence

The density estimation is one of the core problems in statistics. Despite this, existing techniques like maximum likelihood estimation are computationally inefficient due to the intractability of the normalizing constant. For this reason an…

Machine Learning · Computer Science 2021-01-14 Tsimboy Olga , Yermek Kapushev , Evgeny Burnaev , Ivan Oseledets

Recently, classical kernel methods have been extended by the introduction of suitable tensor kernels so to promote sparsity in the solution of the underlying regression problem. Indeed, they solve an lp-norm regularization problem, with…

Machine Learning · Computer Science 2020-03-25 Feliks Hibraj , Marcello Pelillo , Saverio Salzo , Massimiliano Pontil

It is well-known that polynomial reproduction is not possible when approximating with Gaussian kernels. Quasi-interpolation schemes have been developed which use a finite number of Gaussians at different scales, which then reproduce…

Numerical Analysis · Mathematics 2020-01-24 Simon Hubbert , Jeremy Levesley

Nonparametric regression is a standard statistical tool with increased importance in the Big Data era. Boundary points pose additional difficulties but local polynomial regression can be used to alleviate them. Local linear regression, for…

Other Statistics · Statistics 2017-04-04 Srinjoy Das , Dimitris N. Politis

We investigate training and using Gaussian kernel SVMs by approximating the kernel with an explicit finite- dimensional polynomial feature representation based on the Taylor expansion of the exponential. Although not as efficient as the…

Artificial Intelligence · Computer Science 2011-09-22 Andrew Cotter , Joseph Keshet , Nathan Srebro

We propose sparse regression as an alternative to neural networks for the discovery of parsimonious constitutive models (CMs) from oscillatory shear experiments. Symmetry and frame-invariance are strictly imposed by using tensor basis…

Soft Condensed Matter · Physics 2024-08-21 Sachin Shanbhag , Gordon Erlebacher

Differential abundance (DA) analysis in microbiome studies has recently been used to uncover a plethora of associations between microbial composition and various health conditions. While current approaches to DA typically apply only to…

Methodology · Statistics 2026-01-19 Simon Fontaine , Nisha J. D'Silva , Marcell Costa de Medeiros , Grace Y. Chen , Ji Zhu , Gen Li

This paper develops a class of Bayesian non- and semiparametric methods for estimating regression curves and surfaces. The main idea is to model the regression as locally linear, and then place suitable local priors on the local parameters.…

Methodology · Statistics 2026-02-26 Nils Lid Hjort

From a systems biology perspective the majority of cancer models, although interesting and providing a qualitative explanation of some problems, have a major disadvantage in that they usually miss a genuine connection with experimental…

Statistics Theory · Mathematics 2023-05-25 Zuzanna Szymańska , Jakub Skrzeczkowski , Błażej Miasojedow , Piotr Gwiazda

We propose local polynomial estimators for the conditional mean of a continuous response when only pooled response data are collected under different pooling designs. Asymptotic properties of these estimators are investigated and compared.…

Methodology · Statistics 2020-02-11 Dewei Wang , Xichen Mou , Xiang Li , Xianzheng Huang