English
Related papers

Related papers: Robust and Sparse Estimation of Unbounded Density …

200 papers

The problem of large-scale spatial multiple testing is often encountered in various scientific research fields, where the signals are usually enriched on some regions while sparse on others. To integrate spatial structure information from…

Methodology · Statistics 2023-09-28 Pengfei Wang , Pengyu Yan , Canhui Li

Detector-based and detector-free matchers are only applicable within their respective sparsity ranges. To improve adaptability of existing matchers, this paper introduces a novel probabilistic reweighting method. Our method is applicable to…

Image and Video Processing · Electrical Eng. & Systems 2025-04-08 Ya Fan , Rongling Lang

We study the problem of causal function estimation in the Proxy Causal Learning (PCL) framework, where confounders are not observed but proxies for the confounders are available. Two main approaches have been proposed: outcome bridge-based…

Machine Learning · Computer Science 2026-03-27 Bariscan Bozkurt , Houssam Zenati , Dimitri Meunier , Liyuan Xu , Arthur Gretton

Semicontinuous outcomes occur frequently in health services, insurance, and cost studies. Standard nonparametric density estimators are not well suited to such data because they do not naturally accommodate the mixed structure, the…

Methodology · Statistics 2026-05-06 Guanjie Lyu , Frédéric Ouimet , Cindy Feng

Reliable causal effect estimation from observational data requires adjustment for confounding and sufficient overlap in covariate distributions between treatment groups. However, in high-dimensional settings, lack of overlap often inflates…

Methodology · Statistics 2025-03-21 Linying Yang , Robin J. Evans

We study Gaussian sparse estimation tasks in Huber's contamination model with a focus on mean estimation, PCA, and linear regression. For each of these tasks, we give the first sample and computationally efficient robust estimators with…

Machine Learning · Computer Science 2024-03-18 Ilias Diakonikolas , Daniel M. Kane , Sushrut Karmalkar , Ankit Pensia , Thanasis Pittas

We propose a novel active learning strategy for regression, which is model-agnostic, robust against model mismatch, and interpretable. Assuming that a small number of initial samples are available, we derive the optimal training density…

Machine Learning · Computer Science 2021-07-27 Danny Panknin , Klaus Robert Müller , Shinichi Nakajima

Consider the nonparametric regression model Y=m(X)+E, where the function m is smooth but unknown, and E is independent of X. An estimator of the density of the error term E is proposed and its weak consistency is obtained. The contribution…

Statistics Theory · Mathematics 2011-12-25 Rawane Samb

Semi- and non-parametric mixture of regressions are a very useful flexible class of mixture of regressions in which some or all of the parameters are non-parametric functions of the covariates. These models are, however, based on the…

Methodology · Statistics 2026-01-21 Peterson Mambondimumwe , Sphiwe B. Skhosana , Najmeh Nakhaei Rad

We propose a doubly robust estimator for the average treatment effect in high dimensional low sample size observational studies, where contamination and model misspecification pose serious inferential challenges. The estimator combines…

Methodology · Statistics 2025-11-04 Byeonghee Lee , Sangwook Kang , Ju-Hyun Park , Saebom Jeon , Joonsung Kang

The minimum density power divergence estimator (MDPDE) has gained significant attention in the literature of robust inference due to its strong robustness properties and high asymptotic efficiency; it is relatively easy to compute and can…

Statistics Theory · Mathematics 2025-09-16 Suryasis Jana , Subhrajyoty Roy , Ayanendranath Basu , Abhik Ghosh

This paper provides a new methodology to analyze unobserved heterogeneity when observed characteristics are modeled nonlinearly. The proposed model builds on varying random coefficients (VRC) that are determined by nonlinear functions of…

Econometrics · Economics 2020-08-05 Christoph Breunig

We present a comprehensive evaluation of the robustness and explainability of ResNet-like models in the context of Unintended Radiated Emission (URE) classification and suggest a new approach leveraging Neural Stochastic Differential…

Machine Learning · Computer Science 2023-09-28 Sumit Kumar Jha , Susmit Jha , Rickard Ewetz , Alvaro Velasquez

We propose a novel and computationally efficient approach for nonparametric conditional density estimation in high-dimensional settings that achieves dimension reduction without imposing restrictive distributional or functional form…

Econometrics · Economics 2025-10-14 Jianhua Mei , Fu Ouyang , Thomas T. Yang

We introduce a new nonparametric density estimator inspired by Markov Chains, and generalizing the well-known Kernel Density Estimator (KDE). Our estimator presents several benefits with respect to the usual ones and can be used…

Methodology · Statistics 2020-09-15 Andrea De Simone , Alessandro Morandini

Density ratio estimation is a vital tool in both machine learning and statistical community. However, due to the unbounded nature of density ratio, the estimation procedure can be vulnerable to corrupted data points, which often pushes the…

Machine Learning · Statistics 2017-11-07 Song Liu , Akiko Takeda , Taiji Suzuki , Kenji Fukumizu

Density estimation plays a crucial role in many data analysis tasks, as it infers a continuous probability density function (PDF) from discrete samples. Thus, it is used in tasks as diverse as analyzing population data, spatial locations in…

Machine Learning · Computer Science 2021-07-26 Patrik Puchert , Pedro Hermosilla , Tobias Ritschel , Timo Ropinski

Distributionally robust optimization (DRO) has been introduced for solving stochastic programs where the distribution of the random parameters is unknown and must be estimated by samples from that distribution. A key element of DRO is the…

Optimization and Control · Mathematics 2019-01-09 Xi Chen , Qihang Lin , Guanglin Xu

This paper develops a novel approach to density estimation on a network. We formulate nonparametric density estimation on a network as a nonparametric regression problem by binning. Nonparametric regression using local polynomial…

Methodology · Statistics 2020-08-06 Yang Liu , David Ruppert

Noisy data are often viewed as a challenge for decision-making. This paper studies a distributionally robust optimization (DRO) that shows how such noise can be systematically incorporated. Rather than applying DRO to the noisy empirical…

Optimization and Control · Mathematics 2025-09-03 Chung-Han Hsieh , Rong Gan