English
Related papers

Related papers: UMVUE-Type Estimators under Bregman Losses

200 papers

This paper develops numerical and causal interpretations of two-way fixed effects (TWFE) regressions in settings with nonbinary, nonstaggered treatments and time-varying covariates. Using the equivalence between TWFE and pooled…

Econometrics · Economics 2026-03-24 Shoya Ishimaru

Deep neural networks are highly susceptible to learning biases in visual data. While various methods have been proposed to mitigate such bias, the majority require explicit knowledge of the biases present in the training data in order to…

Computer Vision and Pattern Recognition · Computer Science 2024-06-05 Rebecca S Stone , Nishant Ravikumar , Andrew J Bulpitt , David C Hogg

By analogy to the terminology of curved exponential families in statistics, we define curved Bregman divergences as Bregman divergences restricted to non-affine parameter subspaces and sub-dimensional Bregman divergences when the…

Information Theory · Computer Science 2026-03-30 Frank Nielsen

We consider the Buhmann class of compactly supported radial basis functions, whih includes a wealth of special cases that have been studied in both numerical analysis and spatial statistics literatures. In particular, the celebrated Wu,…

Statistics Theory · Mathematics 2016-09-28 E. Porcu , P. Zastavyi , M. Bevilacqua

Via constructing an asymptotic coupling by reflection, in this paper we establish uniform-in-time estimates on probability distances for mean-field type SDEs, where the drift terms under consideration are dissipative merely in the long…

Probability · Mathematics 2024-09-26 Jianhai Bao , Jiaqing Hao

When random effects are correlated with sample design variables, the usual approach of employing individual survey weights (constructed to be inversely proportional to the unit survey inclusion probabilities) to form a pseudo-likelihood no…

Methodology · Statistics 2021-08-26 Terrance D. Savitsky , Matthew R. Williams

We develop an analytical framework for understanding how the generated distribution evolves during diffusion model training. Leveraging a Gaussian-equivalence principle, we solve the full-batch gradient-flow dynamics of linear and…

Machine Learning · Computer Science 2026-04-07 Binxu Wang , Cengiz Pehlevan

Recent work has focused on the problem of nonparametric estimation of information divergence functionals. Many existing approaches are restrictive in their assumptions on the density support set or require difficult calculations at the…

Information Theory · Computer Science 2021-07-30 Kevin R. Moon , Kumar Sricharan , Kristjan Greenewald , Alfred O. Hero

A new DFT+U type corrective functional is derived from first principles to enforce the flat plane condition on localized subspaces, thus dispensing with the need for an ad hoc derivation from the Hubbard model. The newly derived functional…

Strongly Correlated Electrons · Physics 2023-04-17 Andrew Burgess , Edward Linscott , David D. O'Regan

The fusion of raw sensor data to create a Bird's Eye View (BEV) representation is critical for autonomous vehicle planning and control. Despite the growing interest in using deep learning models for BEV semantic segmentation, anticipating…

Machine Learning · Computer Science 2025-03-04 Linlin Yu , Bowen Yang , Tianhao Wang , Kangshuo Li , Feng Chen

We use a statistical-mechanical identity closely related to the familiar virial theorem, to derive unbiased estimators for spatial distribution functions of classical fluids. In particular, we obtain estimators for both the fluid density…

Statistical Mechanics · Physics 2009-11-10 Artur B. Adib , Christopher Jarzynski

In this paper, we study semiparametric inference for linear multivariate Hawkes processes, a class of point processes widely used to describe self and mutually exciting phenomena. We establish a convolution theorem giving the best limiting…

Statistics Theory · Mathematics 2026-03-26 Mael Duverger , Judith Rousseau

The predictive quality of machine learning models is typically measured in terms of their (approximate) expected prediction accuracy or the so-called Area Under the Curve (AUC). Minimizing the reciprocals of these measures are the goals of…

Machine Learning · Statistics 2019-03-04 Hiva Ghanbari , Minhan Li , Katya Scheinberg

We study the approximation of univariate and multivariate set-valued functions (SVFs) by the adaptation to SVFs of positive samples-based approximation operators for real-valued functions. To this end, we introduce a new weighted average of…

Numerical Analysis · Mathematics 2012-11-29 Shay Kels , Nira Dyn

We introduce a temperature into the exponential function and replace the softmax output layer of neural nets by a high temperature generalization. Similarly, the logarithm in the log loss we use for training is replaced by a low temperature…

Machine Learning · Computer Science 2019-09-24 Ehsan Amid , Manfred K. Warmuth , Rohan Anil , Tomer Koren

The (global) Lipschitz smoothness condition is crucial in establishing the convergence theory for most optimization methods. Unfortunately, most machine learning and signal processing problems are not Lipschitz smooth. This motivates us to…

Optimization and Control · Mathematics 2019-04-23 Qiuwei Li , Zhihui Zhu , Gongguo Tang , Michael B. Wakin

Consider discrete values of functions shifted by unobserved translation effects, which are independent realizations of a random variable with unknown distribution $\mu$, modeling the variability in the response of each individual. Our aim…

Statistics Theory · Mathematics 2008-12-18 Ismael Castillo , Jean-Michel Loubes

This paper introduces a general framework for estimating variance components in the linear mixed models via general unbiased estimating equations, which include some well-used estimators such as the restricted maximum likelihood estimator.…

Methodology · Statistics 2021-05-18 Tatsuya Kubokawa , Shonosuke Sugasawa , Hiromasa Tamae , Sanjay Chaudhuri

We provide sharp estimates for the distribution function of a martingale transform of the indicator function of an event. They are formulated in terms of Burkholder functions, which are reduced to the already known Bellman functions for…

Classical Analysis and ODEs · Mathematics 2023-10-05 Dmitriy Stolyarov , Vasily Vasyunin , Pavel Zatitskii

We establish a general semiparametric Bernstein-von Mises theorem for Bayesian nonparametric priors based on continuous observations in a periodic reversible multidimensional diffusion model. We consider a wide range of functionals…

Statistics Theory · Mathematics 2025-05-23 Matteo Giordano , Kolyan Ray