English
Related papers

Related papers: Robust Sure Independence Screening for Non-polynom…

200 papers

We consider the problem of robust inference under the generalized linear model (GLM) with stochastic covariates. We derive the properties of the minimum density power divergence estimator of the parameters in GLM with random design and use…

Methodology · Statistics 2020-04-06 Ayanendranath Basu , Abhik Ghosh , Abhijit Mandal , Nirian Martin , Leandro Pardo

We propose a robust inferential procedure for assessing uncertainties of parameter estimation in high-dimensional linear models, where the dimension $p$ can grow exponentially fast with the sample size $n$. Our method combines the…

Machine Learning · Statistics 2015-03-19 Tianqi Zhao , Mladen Kolar , Han Liu

We solve the problem of estimating the distribution of presumed i.i.d. observations for the total variation loss. Our approach is based on density models and is versatile enough to cope with many different ones, including some density…

Statistics Theory · Mathematics 2024-01-05 Y. Baraud , H. Halconruy , G. Maillard

In this paper, we consider distributed maximum likelihood estimation (MLE) with dependent quantized data under the assumption that the structure of the joint probability density function (pdf) is known, but it contains unknown deterministic…

Information Theory · Computer Science 2013-09-17 Xiaojing Shen , Pramod K. Varshney , Yunmin Zhu

This paper focuses on the problem of Differentially Private Stochastic Optimization for (multi-layer) fully connected neural networks with a single output node. In the first part, we examine cases with no hidden nodes, specifically focusing…

Machine Learning · Computer Science 2023-10-13 Hanpu Shen , Cheng-Long Wang , Zihang Xiang , Yiming Ying , Di Wang

Variable selection is a challenging issue in statistical applications when the number of predictors $p$ far exceeds the number of observations $n$. In this ultra-high dimensional setting, the sure independence screening (SIS) procedure was…

Methodology · Statistics 2015-06-08 Xiangyu Wang , Chenlei Leng

We study the fundamental problem of high-dimensional mean estimation in a robust model where a constant fraction of the samples are adversarially corrupted. Recent work gave the first polynomial time algorithms for this problem with…

Machine Learning · Computer Science 2018-11-26 Yu Cheng , Ilias Diakonikolas , Rong Ge

Unsupervised anomaly detection stands as an important problem in machine learning, with applications in financial fraud prevention, network security and medical diagnostics. Existing unsupervised anomaly detection algorithms rarely perform…

Machine Learning · Computer Science 2026-02-04 Pritam Kar , Rahul Bordoloi , Olaf Wolkenhauer , Saptarshi Bej

This study considers the problem of testing for a parameter change in the presence of outliers. For this, we propose a robust test using the objective function of minimum density power divergence estimator (MDPDE) by Basu et al.…

Statistics Theory · Mathematics 2020-03-04 Junmo Song , Jiwon Kang

Independence screening methods such as the two sample $t$-test and the marginal correlation based ranking are among the most widely used techniques for variable selection in ultrahigh dimensional data sets. In this short note, simple…

Methodology · Statistics 2020-11-17 Run Wang , Somak Dutta , Vivekananda Roy

We propose a new marginal data density estimator (MDDE) that uses the variational Bayes posterior density as a weighting density of the reciprocal importance sampling (RIS) MDDE. This computationally convenient estimator is based on…

Applications · Statistics 2020-05-12 Gholamreza Hajargasht , Tomasz Woźniak

In this article, we study the problem of variable screening in multiple nonparametric regression model. The proposed methodology is based on the fact that the partial derivative of the regression function with respect to the irrelevant…

Methodology · Statistics 2021-01-19 Subhra Sankar Dhar , Prashant Jha , Aranyak Acharyya

We present a robust Distributed and Localized Model Predictive Control (rDLMPC) framework for large-scale structured linear systems. The proposed algorithm uses the System Level Synthesis to provide a distributed closed-loop model…

Optimization and Control · Mathematics 2021-03-29 Carmen Amo Alonso , Jing Shuang Li , Nikolai Matni , James Anderson

Due to the highly non-convex nature of large-scale robust parameter estimation, avoiding poor local minima is challenging in real-world applications where input data is contaminated by a large or unknown fraction of outliers. In this paper,…

Computer Vision and Pattern Recognition · Computer Science 2020-03-23 Huu Le , Christopher Zach

This work is concerned with robust filtering of nonlinear sampled-data systems with and without exact discrete-time models. A linear matrix inequality (LMI) based approach is proposed for the design of robust $H_{\infty}$ observers for a…

Systems and Control · Computer Science 2018-12-27 Masoud Abbaszadeh , Horacio J. Marquez

Polynomial regression is a recurrent problem with a large number of applications. In computer vision it often appears in motion analysis. Whatever the application, standard methods for regression of polynomial models tend to deliver biased…

Computer Vision and Pattern Recognition · Computer Science 2018-05-24 Juan-Manuel Perez-Rua , Tomas Crivelli , Patrick Bouthemy , Patrick Perez

Density-based minimum divergence procedures represent popular techniques in parametric statistical inference. They combine strong robustness properties with high (sometimes full) asymptotic efficiency. Among density-based minimum distance…

Methodology · Statistics 2020-12-23 Pushpinder Singh , Abhijit Mandal , Ayanendranath Basu

Screening is the problem of finding a superset of the set of non-zero entries in an unknown p-dimensional vector \beta* given n noisy observations. Naturally, we want this superset to be as small as possible. We propose a novel framework…

Machine Learning · Statistics 2016-11-18 Divyanshu Vats

The sparsity-restricted maximum likelihood estimator (SMLE) has received considerable attention for feature screening in ultrahigh-dimensional regression. SMLE is a computationally convenient method that naturally incorporates the joint…

Other Statistics · Statistics 2022-01-11 Qianxiang Zang , Chen Xu , Kelly Burkett

We present a novel view of nonlinear manifold learning using derivative-free optimization techniques. Specifically, we propose an extension of the classical multi-dimensional scaling (MDS) method, where instead of performing gradient…