中文
相关论文

相关论文: Asymptotics for sliced average variance estimation

200 篇论文

Sliced Mutual Information (SMI) is widely used as a scalable alternative to mutual information for measuring non-linear statistical dependence. Despite its advantages, such as faster convergence, robustness to high dimensionality, and…

机器学习 · 计算机科学 2025-12-10 Alexander Semenenko , Ivan Butakov , Alexey Frolov , Ivan Oseledets

In this paper, we investigate the principle that `good explanations are hard to vary' in the context of deep learning. We show that averaging gradients across examples -- akin to a logical OR of patterns -- can favor memorization and…

We discuss recently developed methods that quantify the stability and generalizability of statistical findings under distributional changes. In many practical problems, the data is not drawn i.i.d. from the target population. For example,…

统计方法学 · 统计学 2023-10-05 Dominik Rothenhäusler , Peter Bühlmann

In this paper, by employing the asymptotic expansion method, we prove the existence and uniqueness of a smoothing solution for a time-dependent nonlinear singularly perturbed partial differential equation (PDE) with a small-scale parameter.…

数值分析 · 数学 2022-10-11 Dmitrii Chaikovskii , Ye Zhang

This paper revisits a fundamental problem in statistical inference from a non-asymptotic theoretical viewpoint $\unicode{x2013}$ the construction of confidence sets. We establish a finite-sample bound for the estimator, characterizing its…

统计理论 · 数学 2023-01-03 Lang Liu , Zaid Harchaoui

In the Bayesian approach, the a priori knowledge about the input of a mathematical model is described via a probability measure. The joint distribution of the unknown input and the data is then conditioned, using Bayes' formula, giving rise…

统计理论 · 数学 2015-06-15 Sebastian J. Vollmer

Sharpness-Aware Minimization (SAM) has emerged as a powerful method for improving generalization in machine learning models by minimizing the sharpness of the loss landscape. However, despite its success, several important questions…

最优化与控制 · 数学 2025-03-05 Dimitris Oikonomou , Nicolas Loizou

Gaussian smoothed sliced Wasserstein distance has been recently introduced for comparing probability distributions, while preserving privacy on the data. It has been shown that it provides performances similar to its non-smoothed…

机器学习 · 计算机科学 2024-04-26 Mokhtar Z. Alaya , Alain Rakotomamonjy , Maxime Berar , Gilles Gasso

We study the basic statistical problem of testing whether normally distributed $n$-dimensional data has been truncated, i.e. altered by only retaining points that lie in some unknown truncation set $S \subseteq \mathbb{R}^n$. As our main…

数据结构与算法 · 计算机科学 2024-11-25 Anindya De , Shivam Nadimpalli , Rocco A. Servedio

Consider the regression problem where the response $Y\in\mathbb{R}$ and the covariate $X\in\mathbb{R}^d$ for $d\geq 1$ are \textit{unmatched}. Under this scenario, we do not have access to pairs of observations from the distribution of $(X,…

统计理论 · 数学 2023-09-19 Mona Azadkia , Fadoua Balabdaoui

There exist several methods developed for the canonical change point problem of detecting multiple mean shifts, which search for changes over sections of the data at multiple scales. In such methods, estimation of the noise level is often…

统计方法学 · 统计学 2022-11-07 Euan T. McGonigle , Haeran Cho

In this paper we have considered the problem of estimating the population mean in systematic sampling using information on an auxiliary variable in presence of non response. Some modified ratio, product and difference type estimators in…

统计方法学 · 统计学 2014-03-06 Hemant K. Verma , R. D. Singh , Rajesh Singh

We study the asymptotic behavior of piecewise constant least squares regression estimates, when the number of partitions of the estimate is penalized. We show that the estimator is consistent in the relevant metric if the signal is in…

统计理论 · 数学 2009-09-29 Leif Boysen , Volkmar Liebscher , Axel Munk , Olaf Wittich

This paper studies resilient distributed estimation under measurement attacks. A set of agents each makes successive local, linear, noisy measurements of an unknown vector field collected in a vector parameter. The local measurement models…

最优化与控制 · 数学 2019-10-02 Yuan Chen , Soummya Kar , José M. F. Moura

We study asymptotic behaviour of stochastic approximation procedures with three main characteristics: truncations with random moving bounds, a matrix valued random step-size sequence, and a dynamically changing random regression function.…

统计理论 · 数学 2016-11-22 Teo Sharia , Lei Zhong

In this paper we consider the stacking of isotonic regression and the method of rearrangement with the empirical estimator to estimate a discrete distribution with an infinite support. The estimators are proved to be strongly consistent…

统计理论 · 数学 2022-08-23 Vladimir Pastukhov

Theoretical developments on cross validation (CV) have mainly focused on selecting one among a list of finite-dimensional models (e.g., subset or order selection in linear regression) or selecting a smoothing parameter (e.g., bandwidth for…

统计理论 · 数学 2008-12-18 Yuhong Yang

Consider the Gaussian sequence model under the additional assumption that a fixed fraction of the means is known. We study the problem of variance estimation from a frequentist Bayesian perspective. The maximum likelihood estimator (MLE)…

统计理论 · 数学 2019-12-19 Gianluca Finocchio , Johannes Schmidt-Hieber

We consider stochastic optimization problems which use observed data to estimate essential characteristics of the random quantities involved. Sample average approximation (SAA) or empirical (plug-in) estimation are very popular ways to use…

统计理论 · 数学 2021-03-16 Darinka Dentcheva , Yang Lin

Semiparametric estimators admitting a von Mises expansion often reduce inference to the influence-function variance. This reduction is justified when the second-order remainder is negligible in variance, a condition that is stronger than…

统计方法学 · 统计学 2026-05-26 Lin Li , Pengcheng Wu