English
Related papers

Related papers: Towards a better understanding of the dual represe…

200 papers

This paper introduces a robust estimation framework based solely on the copula function. We begin by introducing a family of divergence measures tailored for copulas, including the \(\alpha\)-, \(\beta\)-, and \(\gamma\)-copula divergences,…

Methodology · Statistics 2025-09-18 Shinto Eguchi , Shogo Kato

Robust estimators and Wald-type tests are developed for the multinomial logistic regression based on $\phi$-divergence measures. The robustness of the proposed estimators and tests is proved through the study of their influence functions…

Statistics Theory · Mathematics 2021-02-08 Elena Castilla , Pedro J. Chocano

Robust inferential methods based on divergences measures have shown an appealing trade-off between efficiency and robustness in many different statistical models. In this paper, minimum density power divergence estimators (MDPDEs) for the…

Statistics Theory · Mathematics 2023-12-06 A. Felipe , M. Jaenada , P. Miranda , L. Pardo

This paper introduces the $f$-sensitivity model, a new sensitivity model that characterizes the violation of unconfoundedness in causal inference. It assumes the selection bias due to unmeasured confounding is bounded "on average"; compared…

Methodology · Statistics 2022-09-07 Ying Jin , Zhimei Ren , Zhengyuan Zhou

The association between a continuous and an ordinal variable is commonly modeled through the polyserial correlation model. However, this model, which is based on a partially-latent normality assumption, may be misspecified in practice, due…

Methodology · Statistics 2026-02-11 Max Welz

We revisit the classical problem of estimating an unknown distribution from its samples by fitting a mixture model that minimizes cross-entropy loss. Framing the task as a stochastic convex optimization problem over the space of $ M…

Machine Learning · Statistics 2026-05-26 Mohammadreza Ahmadypour , Tara Javidi , Farinaz Koushanfar

Density ratio estimation (DRE) is a fundamental machine learning technique for capturing relationships between two probability distributions. State-of-the-art DRE methods estimate the density ratio using neural networks trained with loss…

Machine Learning · Statistics 2025-03-18 Yoshiaki Kitazawa

This paper deals with the problem of outliers in high frequency observation data from diffusion processes. Robust estimation methods are needed because the inclusion of outliers can lead to incorrect statistical inference even in the…

Methodology · Statistics 2026-03-06 Tomoyuki Nakagawa , Yusuke Shimizu

This paper is based on our personal notes for the short course we gave on January 5, 2017 at Institut Henri Poincar\'e, after an invitation of the SFdS. Our purpose is to give an overview of the method of $\rho$-estimation and of the…

Statistics Theory · Mathematics 2017-07-04 Yannick Baraud , Lucien Birgé

This article develops the theoretical framework needed to study the multinomial logistic regression model for complex sample design with pseudo minimum phi-divergence estimators. Through a numerical example and simulation study new…

Methodology · Statistics 2016-06-06 Elena Castilla , Nirian Martin , Leandro Pardo

In this paper, we exploit the so-called value function reformulation of the bilevel optimization problem to develop duality results for the problem. Our approach builds on Fenchel-Lagrange-type duality to establish suitable results for the…

Optimization and Control · Mathematics 2022-05-24 Houria En-Naciri , Lahoussine Lafhim , Alain Zemkoho

We develop a divergence-minimization (DM) framework for robust and efficient inference in latent-mixture models. By optimizing a residual-adjusted divergence, the DM approach recovers EM as a special case and yields robust alternatives…

Statistics Theory · Mathematics 2025-11-25 Lei Li , Anand N. Vidyashankar

The dual formulation of empirical risk minimization with f-divergence regularization (ERM-fDR) is introduced. The solution of the dual optimization problem to the ERM-fDR is connected to the notion of normalization function introduced as an…

Machine Learning · Statistics 2025-08-06 Francisco Daunas , Iñaki Esnaola , Samir M. Perlaza

The most popular hypothesis testing procedure, the likelihood ratio test, is known to be highly non-robust in many real situations. Basu et al. (2013a) provided an alternative robust procedure of hypothesis testing based on the density…

Statistics Theory · Mathematics 2016-07-04 Abhik Ghosh , Ayanendranath Basu , Leandro Pardo

In real life, we frequently come across data sets that involve some independent explanatory variable(s) generating a set of ordinal responses. These ordinal responses may correspond to an underlying continuous latent variable, which is…

Methodology · Statistics 2024-01-08 Arijit Pyne , Subhrajyoty Roy , Abhik Ghosh , Ayanendranath Basu

We propose a new family of regularized R\'enyi divergences parametrized not only by the order $\alpha$ but also by a variational function space. These new objects are defined by taking the infimal convolution of the standard R\'enyi…

Machine Learning · Statistics 2023-02-16 Jeremiah Birrell , Yannis Pantazis , Paul Dupuis , Markos A. Katsoulakis , Luc Rey-Bellet

Doubly robust estimators (DRE) are widely used in causal inference because they yield consistent estimators of average causal effect when at least one of the nuisance models, the propensity for treatment (exposure) or the outcome…

Methodology · Statistics 2025-11-25 Hao Wu , Lucy Shao , Toni Gui , Tsungchin Wu , Zhuochao Huang , Shengjia Tu , Xin Tu , Jinyuan Liu , Tuo Lin

We examine the duality theory for a class of non-convex functions obtained by composing a convex function with a continuous one. Using Fenchel duality, we derive a dual problem that satisfies weak duality under general assumptions. To…

Optimization and Control · Mathematics 2025-10-08 Vittorio Latorre

Density power divergence (DPD) is designed to robustly estimate the underlying distribution of observations, in the presence of outliers. However, DPD involves an integral of the power of the parametric density models to be estimated; the…

Methodology · Statistics 2024-02-09 Akifumi Okuno

In various practical situations, we encounter data from stochastic processes which can be efficiently modelled by an appropriate parametric model for subsequent statistical analyses. Unfortunately, the most common estimation and inference…

Methodology · Statistics 2022-04-12 Rohan Hore , Abhik Ghosh