English
Related papers

Related papers: Kernel-Based Nonparametric Tests For Shape Constra…

200 papers

This paper proposes a max-test for testing (possibly infinitely) many zero parameter restrictions in an extremum estimation framework. The test statistic is formed by estimating key parameters one at a time based on many empirical loss…

Statistics Theory · Mathematics 2022-04-12 Jonathan B. Hill

It is a commonly held belief that enforcing invariance improves generalisation. Although this approach enjoys widespread popularity, it is only very recently that a rigorous theoretical demonstration of this benefit has been established. In…

Machine Learning · Statistics 2021-12-21 Bryn Elesedy

In this paper we investigate and compare different gradient algorithms designed for the domain expression of the shape derivative. Our main focus is to examine the usefulness of kernel reproducing Hilbert spaces for PDE constrained shape…

Optimization and Control · Mathematics 2016-04-20 Martin Eigel , Kevin Sturm

We propose novel kernel-based tests for assessing the equivalence between distributions. Traditional goodness-of-fit testing is inappropriate for concluding the absence of distributional differences, because failure to reject the null…

Machine Learning · Statistics 2026-03-17 Xing Liu , Axel Gandy

We propose a series-based nonparametric specification test for a regression function when data are spatially dependent, the `space' being of a general economic or social nature. Dependence can be parametric, parametric with increasing…

Econometrics · Economics 2022-08-30 Abhimanyu Gupta , Xi Qu

We develop a systematic, omnibus approach to goodness-of-fit testing for parametric distributional models when the variable of interest is only partially observed due to censoring and/or truncation. In many such designs, tests based on the…

Methodology · Statistics 2026-02-10 Juan Carlos Escanciano , Jacobo de Uña-Álvarez

In statistical machine learning, kernel methods allow to consider infinite dimensional feature spaces with a computational cost that only depends on the number of observations. This is usually done by solving an optimization problem…

Optimization and Control · Mathematics 2019-01-17 Guillaume Garrigos , Lorenzo Rosasco , Silvia Villa

This paper studies the problem of nonparametric testing for the effect of a random functional covariate on a real-valued error term. The covariate takes values in $L^2[0,1]$, the Hilbert space of the square-integrable real-valued functions…

Statistics Theory · Mathematics 2012-05-28 Valentin Patilea , Cesar Sanchez-Sellero , Matthieu Saumard

Early stopping of iterative algorithms is an algorithmic regularization method to avoid over-fitting in estimation and classification. In this paper, we show that early stopping can also be applied to obtain the minimax optimal testing in a…

Statistics Theory · Mathematics 2018-09-18 Meimei Liu , Guang Cheng

Kernel mean embeddings are a popular tool that consists in representing probability measures by their infinite-dimensional mean embeddings in a reproducing kernel Hilbert space. When the kernel is characteristic, mean embeddings can be used…

Machine Learning · Computer Science 2021-06-29 Boris Muzellec , Francis Bach , Alessandro Rudi

Dealing with NP-hard problems, kernelization is a fundamental notion for polynomial-time data reduction with performance guarantees: in polynomial time, a problem instance is reduced to an equivalent instance with size upper-bounded by a…

Data Structures and Algorithms · Computer Science 2022-12-26 Matthias Bentert , René van Bevern , Till Fluschnik , André Nichterlein , Rolf Niedermeier

In this paper we offer a unified approach to the problem of nonparametric regression on the unit interval. It is based on a universal, honest and non-asymptotic confidence region which is defined by a set of linear inequalities involving…

Statistics Theory · Mathematics 2007-11-06 P. L. Davies , A. Kovac , M. Meise

This paper is concerned with the development, analysis and numerical realization of a novel variational model for the regularization of inverse problems in imaging. The proposed model is inspired by the architecture of generative…

Optimization and Control · Mathematics 2021-11-10 Andreas Habring , Martin Holler

This paper presents a kernelized offset-free data-driven predictive control scheme for nonlinear systems. Traditional model-based and data-driven predictive controllers often struggle with inaccurate predictors or persistent disturbances,…

Systems and Control · Electrical Eng. & Systems 2024-12-02 Thomas Oliver de Jong , Mircea Lazar

We propose a method for efficiently incorporating constraints into a stochastic gradient Langevin framework for the training of deep neural networks. Constraints allow direct control of the parameter space of the model. Appropriately…

Machine Learning · Computer Science 2021-06-22 Benedict Leimkuhler , Timothée Pouchon , Tiffany Vlaar , Amos Storkey

Psychiatric neuroscience is increasingly aware of the need to define psychopathology in terms of abnormal neural computation. The central tool in this endeavour is the fitting of computational models to behavioural data. The most prominent…

Quantitative Methods · Quantitative Biology 2018-03-28 Abraham Nunes , Alexander Rudiuk

A principal curve serves as a powerful tool for uncovering underlying structures of data through 1-dimensional smooth and continuous representations. On the basis of optimal transport theories, this paper introduces a novel principal curve…

Methodology · Statistics 2025-01-15 Tongseok Lim , Kyeongsik Nam , Jinwon Sohn

For various applications, the relations between the dependent and independent variables are highly nonlinear. Consequently, for large scale complex problems, neural networks and regression trees are commonly preferred over linear models…

Machine Learning · Computer Science 2017-05-23 Samet Oymak , Mehrdad Mahdavi , Jiasi Chen

This paper presents a new perspective on the identification at infinity for the intercept of the sample selection model as identification at the boundary via a transformation of the selection index. This perspective suggests generalizations…

Econometrics · Economics 2023-02-13 Zhewen Pan

In this paper we propose and study a class of simple, nonparametric, yet interpretable measures of association between two random variables $X$ and $Y$ taking values in general topological spaces. These nonparametric measures -- defined…

Statistics Theory · Mathematics 2020-10-09 Nabarun Deb , Promit Ghosal , Bodhisattva Sen