English
Related papers

Related papers: Nonparametric Regression in Dirichlet Spaces: A Ra…

200 papers

The paper considers nonparametric kernel density/regression estimation from a stochastic optimization point of view. The estimation problem is represented through a family of stochastic optimization problems. Recursive constrained…

Statistics Theory · Mathematics 2024-09-05 Vladimir Norkin , Vladimir Kirilyuk

Random Forests and Gradient Boosting are among the most effective algorithms for supervised learning on tabular data. Both belong to the class of tree-based ensemble methods, where predictions are obtained by aggregating many randomized…

Machine Learning · Statistics 2025-12-02 Mehdi Dagdoug , Clement Dombry , Jean-Jil Duchamps

We propose a non-parametric variant of binary regression, where the hypothesis is regularized to be a Lipschitz function taking a metric space to [0,1] and the loss is logarithmic. This setting presents novel computational and statistical…

Machine Learning · Computer Science 2020-10-21 Ariel Avital , Klim Efremenko , Aryeh Kontorovich , David Toplin , Bo Waggoner

The paper deals with the nonparametric estimation problem at a given fixed point for an autoregressive model with unknown distributed noise. Kernel estimate modifications are proposed. Asymptotic minimax and efficiency properties for…

Statistics Theory · Mathematics 2008-06-19 Ouerdia Arkoun , Serguei Pergamenchtchikov

The present study investigates a linear-quadratic Dirichlet control problem governed by a non-coercive elliptic equation posed on a possibly non-convex polygonal domain. Tikhonov regularization is carried out in an energy seminorm. The…

Optimization and Control · Mathematics 2026-03-11 Thomas Apel , Mariano Mateos , Arnd Rösch

Modern Bayesian optimization and adaptive sampling methods increasingly rely on nonlinear parametric models, yet theoretical guarantees for such models under adaptive data collection remain limited. Existing analyses largely focus on…

Machine Learning · Statistics 2026-05-14 Rafael Oliveira

Non-linear systems of differential equations have attracted the interest in fields like system biology, ecology or biochemistry, due to their flexibility and their ability to describe dynamical systems. Despite the importance of such models…

Methodology · Statistics 2014-05-09 Javier González , Ivan Vujačić , Ernst Wit

We study second-order hyperbolic equations with degenerate elliptic operators and non-homogeneous Dirichlet boundary inputs. We establish existence and regularity of weak solutions in weighted Sobolev spaces under mild assumptions on the…

Analysis of PDEs · Mathematics 2026-02-10 Donghui Yang , Jie Zhong

This paper investigates a general regularization framework for unsupervised domain adaptation in vector-valued regression under the covariate shift assumption, utilizing vector-valued reproducing kernel Hilbert spaces (vRKHS). Covariate…

Statistics Theory · Mathematics 2026-01-30 Markus Holzleitner , Sergiy Pereverzyev , Sergei V. Pereverzyev , Vaibhav Silmana , S. Sivananthan

Precision matrix estimation is a cornerstone concept in statistics, economics, and finance. Despite advances in recent years, estimation methods that are simultaneously (i) dense, (ii) consistent, and (iii) model-free are lacking. While…

Econometrics · Economics 2025-12-05 Mehmet Caner Agostino Capponi Mihailo Stojnic

In scientific applications, multivariate observations often come in tandem with temporal or spatial covariates, with which the underlying signals vary smoothly. The standard approaches such as principal component analysis and factor…

Statistics Theory · Mathematics 2019-10-15 Mark Koudstaal , Dengdeng Yu , Dehan Kong , Fang Yao

In this paper, we present an efficient algorithm for solving a class of chance constrained optimization under non-parametric uncertainty. Our algorithm is built on the possibility of representing arbitrary distributions as functions in…

Robotics · Computer Science 2018-11-26 Bharath Gopalakrishnan , Arun Kumar Singh , K. Madhava Krishna , Dinesh Manocha

We study the problem of high-dimensional robust mean estimation in the presence of a constant fraction of adversarial outliers. A recent line of work has provided sophisticated polynomial-time algorithms for this problem with…

Machine Learning · Computer Science 2020-05-05 Yu Cheng , Ilias Diakonikolas , Rong Ge , Mahdi Soltanolkotabi

In this work, we analyze the regularizing property of the stochastic gradient descent for the efficient numerical solution of a class of nonlinear ill-posed inverse problems in Hilbert spaces. At each step of the iteration, the method…

Optimization and Control · Mathematics 2019-07-09 Bangti Jin , Zehui Zhou , Jun Zou

A structure-preserving kernel ridge regression method is presented that allows the recovery of globally defined, potentially high-dimensional, and nonlinear Hamiltonian functions on Poisson manifolds out of datasets made of noisy…

Numerical Analysis · Mathematics 2025-04-21 Jianyu Hu , Juan-Pablo Ortega , Daiying Yin

Distribution regression seeks to estimate the conditional distribution of a multivariate response given a continuous covariate. This approach offers a more complete characterization of dependence than traditional regression methods.…

Statistics Theory · Mathematics 2025-06-10 Rong Tang , Yun Yang

A non-homogeneous mixed local and nonlocal problem in divergence form is investigated for the validity of the global Calder\'on-Zygmund estimate for the weak solution to the Dirichlet problem of a nonlinear elliptic equation. We establish…

Analysis of PDEs · Mathematics 2023-03-31 S. -S. Byun , D. Kumar , H. -S. Lee

Logistic regression is a ubiquitous method for probabilistic classification. However, the effectiveness of logistic regression depends upon careful and relatively computationally expensive tuning, especially for the regularisation…

Machine Learning · Computer Science 2025-04-04 Angus Dempster , Geoffrey I. Webb , Daniel F. Schmidt

This paper concerns models and convergence principles for dealing with stochasticity in a wide range of algorithms arising in nonlinear analysis and optimization in Hilbert spaces. It proposes a flexible geometric framework within which…

Optimization and Control · Mathematics 2026-02-17 Patrick L. Combettes , Javier I. Madariaga

We consider a general linear parabolic problem with extended time boundary conditions (including initial value problems and periodic ones), and approximate it by the implicit Euler scheme in time and the Gradient Discretisation method in…

Numerical Analysis · Mathematics 2023-08-22 J Droniou , R Eymard , T Gallouët , C Guichard , R Herbin