English
Related papers

Related papers: Dual divergence estimators and tests: robustness r…

200 papers

We develop and analyze $M$-estimation methods for divergence functionals and the likelihood ratios of two probability distributions. Our method is based on a non-asymptotic variational characterization of $f$-divergences, which allows the…

Statistics Theory · Mathematics 2016-11-18 XuanLong Nguyen , Martin J. Wainwright , Michael I. Jordan

Missing data is frequently encountered in many areas of statistics. Propensity score weighting is a popular method for handling missing data. The propensity score method employs a response propensity model, but correct specification of the…

Methodology · Statistics 2024-03-28 Hengfang Wang , Jae Kwang Kim , Jeongseop Han , Youngjo Lee

Entropy and its various generalizations are important in many fields, including mathematical statistics, communication theory, physics and computer science, for characterizing the amount of information associated with a probability…

This paper concerns the robust regression model when the number of predictors and the number of observations grow in a similar rate. Theory for M-estimators in this regime has been recently developed by several authors [El Karoui et al.,…

Statistics Theory · Mathematics 2016-04-06 Daniel Nevo , Ya'acov Ritov

Statistical and structural modeling represent two distinct approaches to data analysis. In this paper, we propose a set of novel methods for combining statistical and structural models for improved prediction and causal inference. Our first…

Econometrics · Economics 2020-06-11 Jiaming Mao , Jingzhi Xu

The analysis of the double-diffusion model and $\mathbf{H}(\mathrm{div})$-conforming method introduced in [B\"urger, M\'endez, Ruiz-Baier, SINUM (2019), 57:1318--1343] is extended to the time-dependent case. In addition, the efficiency and…

Numerical Analysis · Mathematics 2021-02-12 Raimund Bürger , Arbaz Khan , Paul E. Méndez , Ricardo Ruiz-Baier

Functional data analysis is a fast evolving branch of modern statistics and the functional linear model has become popular in recent years. However, most estimation methods for this model rely on generalized least squares procedures and…

Methodology · Statistics 2020-06-24 Ioannis Kalogridis , Stefan Van Aelst

The parameters of the log-logistic distribution are generally estimated based on classical methods such as maximum likelihood estimation, whereas these methods usually result in severe biased estimates when the data contain outliers. In…

Methodology · Statistics 2022-09-16 Zhuanzhuan Ma , Min Wang , Chanseok Park

Binary classification is a task that involves the classification of data into one of two distinct classes. It is widely utilized in various fields. However, conventional classifiers tend to make overconfident predictions for data that…

Machine Learning · Computer Science 2025-03-13 Shoma Yokura , Akihisa Ichiki

We consider estimation and inference in a linear model with endogenous regressors where the parameters of interest change across two samples. If the first-stage is common, we show how to use this information to obtain more efficient…

Econometrics · Economics 2024-06-26 Bertille Antoine , Otilia Boldea , Niccolo Zaccaria

Combining information from multiple samples is often needed in biomedical and economic studies, but the differences between these samples must be appropriately taken into account in the analysis of the combined data. We study estimation for…

Methodology · Statistics 2018-08-14 Heng Shu , Zhiqiang Tan

To ensure trust in AI models, it is becoming increasingly apparent that evaluation of models must be extended beyond traditional performance metrics, like accuracy, to other dimensions, such as fairness, explainability, adversarial…

Machine Learning · Computer Science 2021-10-01 Moninder Singh , Gevorg Ghalachyan , Kush R. Varshney , Reginald E. Bryant

The goal of this paper is to analyze an intriguing phenomenon recently discovered in deep networks, namely their instability to adversarial perturbations (Szegedy et. al., 2014). We provide a theoretical framework for analyzing the…

Machine Learning · Computer Science 2016-03-30 Alhussein Fawzi , Omar Fawzi , Pascal Frossard

The presence of outlying observations may adversely affect statistical testing procedures that result in unstable test statistics and unreliable inferences depending on the distortion in parameter estimates. In spite of the fact that the…

Methodology · Statistics 2021-04-19 Beste Hamiye Beyaztas , Soutir Bandyopadhyay , Abhijit Mandal

We present two new estimators for estimating the entropy of absolutely continuous random variables. Some properties of them are considered, specifically consistency of the first is proved. The introduced estimators are compared with the…

Statistics Theory · Mathematics 2014-05-05 A. Kohansal , S. Rezakhah

Differentiable simulators promise faster computation time for reinforcement learning by replacing zeroth-order gradient estimates of a stochastic objective with an estimate based on first-order gradients. However, it is yet unclear what…

Machine Learning · Computer Science 2022-08-23 H. J. Terry Suh , Max Simchowitz , Kaiqing Zhang , Russ Tedrake

Doubly robust estimators with cross-fitting have gained popularity in causal inference due to their favorable structure-agnostic error guarantees. However, when additional structure, such as H\"{o}lder smoothness, is available then more…

Statistics Theory · Mathematics 2025-05-08 Alec McClean , Sivaraman Balakrishnan , Edward H. Kennedy , Larry Wasserman

In causal inference confounding may be controlled either through regression adjustment in an outcome model, or through propensity score adjustment or inverse probability of treatment weighting, or both. The latter approaches, which are…

Methodology · Statistics 2017-01-17 Olli Saarela , Léo R. Belzile , David A. Stephens

This paper studies distributionally robust optimization for a rich class of risk measures with ambiguity sets defined by $\phi$-divergences. The risk measures are allowed to be non-linear in probabilities, are represented by Choquet…

Optimization and Control · Mathematics 2025-04-15 Guanyu Jin , Roger J. A. Laeven , Dick den Hertog

Robustness of linear systems with constant coefficients is considered. There exist methods and tools for analyzing the stability of systems with random or deterministic uncertainties. At the same time, there are no approaches for the…

Optimization and Control · Mathematics 2020-12-08 Andrey Tremba