English
Related papers

Related papers: Limiting the Shrinkage for the Exceptional by Obje…

200 papers

In this work, we focus on a variant of the generalized linear model (GLM) called corrupted GLM (CGLM) with heavy-tailed features and responses. To robustify the statistical inference on this model, we propose to apply $\ell_4$-norm…

Methodology · Statistics 2020-07-21 Ziwei Zhu , Wenjing Zhou

Bayesian doubly robust (DR) causal inference faces a fundamental dilemma: joint modeling of outcome and propensity score suffers from the feedback problem where outcome information contaminates propensity score estimation, while two-step…

Methodology · Statistics 2026-01-05 Shunichiro Orihara , Tomotaka Momozaki , Shonosuke Sugasawa

Thompson Sampling provides an efficient technique to introduce prior knowledge in the multi-armed bandit problem, along with providing remarkable empirical performance. In this paper, we revisit the Thompson Sampling algorithm under rewards…

Machine Learning · Computer Science 2019-12-09 Abhimanyu Dubey , Alex Pentland

While research in robust optimization has attracted considerable interest over the last decades, its algorithmic development has been hindered by several factors. One of them is a missing set of benchmark instances that make algorithm…

Optimization and Control · Mathematics 2019-02-11 Marc Goerigk , Stephen J. Maher

This paper addresses the weak instruments problem in linear instrumental variable models from a Bayesian perspective. The new approach has two components. First, a novel predictor-dependent shrinkage prior is developed for the many…

Methodology · Statistics 2014-08-05 P. Richard Hahn , Hedibert Lopes

Causal effect estimation from observational data is an important and much studied research topic. The instrumental variable (IV) and local causal discovery (LCD) patterns are canonical examples of settings where a closed-form expression…

Machine Learning · Statistics 2018-09-19 Ioan Gabriel Bucur , Tom Claassen , Tom Heskes

We propose a general methodology for performing statistical inference within a `rare-events regime' that was recently suggested by Wagner, Viswanath and Kulkarni. Our approach allows one to easily establish consistent estimators for a very…

Information Theory · Computer Science 2011-10-07 Mesrob I. Ohannessian , Vincent Y. F. Tan , Munther A. Dahleh

Extrapolation from a source to a target, e.g., from adults to children, is a promising approach to utilizing external information when data are sparse. In the context of meta-analysis, one is commonly faced with a small number of studies,…

Methodology · Statistics 2019-01-21 Christian Röver , Simon Wandel , Tim Friede

Skew normal model suffers from inferential drawbacks, namely singular Fisher information in the vicinity of symmetry and diverging of maximum likelihood estimation. To address the above drawbacks, Azzalini and Arellano-Valle (2013)…

Methodology · Statistics 2024-01-25 Jian Zhang , Tong Wang

Due to its linear complexity, naive Bayes classification remains an attractive supervised learning method, especially in very large-scale settings. We propose a sparse version of naive Bayes, which can be used for feature selection. This…

Machine Learning · Computer Science 2025-03-13 Armin Askari , Alexandre d'Aspremont , Laurent El Ghaoui

To handle with inverse problems, two probabilistic approaches have been proposed: the maximum entropy on the mean (MEM) and the Bayesian estimation (BAYES). The main object of this presentation is to compare these two approaches which are…

Data Analysis, Statistics and Probability · Physics 2007-05-23 A. Mohammad-Djafari

By the nature of their construction, many statistical models for extremes result in likelihood functions that are computationally prohibitive to evaluate. This is consequently problematic for the purposes of likelihood-based inference. With…

Methodology · Statistics 2014-11-07 Robert Erhardt , Scott A. Sisson

We consider a novel paradigm for Bayesian testing of hypotheses and Bayesian model comparison. Our alternative to the traditional construction of posterior probabilities that a given hypothesis is true or that the data originates from a…

Methodology · Statistics 2019-01-01 Kaniav Kamary , Kerrie Mengersen , Christian P. Robert , Judith Rousseau

Scientists continue to develop increasingly complex mechanistic models to reflect their knowledge more realistically. Statistical inference using these models can be challenging since the corresponding likelihood function is often…

Computation · Statistics 2026-01-07 Joshua J Bon , David J Warne , David J Nott , Christopher Drovandi

This paper presents a number of new findings about the canonical change point estimation problem. The first part studies the estimation of a change point on the real line in a simple stump model using the robust Huber estimating function…

Statistics Theory · Mathematics 2021-05-26 Debarghya Mukherjee , Moulinath Banerjee , Ya'acov Ritov

We generalize the approach of Liu and Lawrence (1999) for multiple changepoint problems where the number of changepoints is unknown. The approach is based on dynamic programming recursion for efficient calculation of the marginal…

Computation · Statistics 2009-09-29 Heng Lian

We study the asymptotic behaviour of widely used tests for evaluating and comparing predictive accuracy when forecast errors exhibit heavy tails. In particular, when loss differentials have infinite variance, the Diebold-Mariano test…

Methodology · Statistics 2026-05-20 Jonas F. Frederiksen , Muneya Matsui , Rasmus S. Pedersen

Rare disease trials face unique statistical challenges due to limited patient populations and heterogeneous clinical manifestations among patients. Multiple endpoints are often necessary to comprehensively capture treatment benefits. A…

Methodology · Statistics 2026-05-05 Tianyue Zhou , Susan Gruber , Hana Lee , Wonyul Lee , Lei Nie , Mark van der Laan

A large body of work in the statistics and computer science communities dating back to Huber (Huber, 1960) has led to statistically and computationally efficient outlier-robust estimators. Two particular outlier models have received…

Statistics Theory · Mathematics 2024-11-26 Yeshwanth Cherapanamjeri , Daniel Lee

Chance constraints provide a principled framework to mitigate the risk of high-impact extreme events by modifying the controllable properties of a system. The low probability and rare occurrence of such events, however, impose severe…

Optimization and Control · Mathematics 2022-01-11 Shanyin Tong , Anirudh Subramanyam , Vishwas Rao