English
Related papers

Related papers: Bias-corrected estimator for intrinsic dimension a…

200 papers

Despite the popular of multimodal statistical models, there lacks rigorous statistical inference tools for inferring the significance of a single modality within a multimodal model, especially in high-dimensional models. For…

Methodology · Statistics 2026-02-04 Wanting Jin , Guorong Wu , Quefeng Li

The bias of an estimator is defined as the difference of its expected value from the parameter to be estimated, where the expectation is with respect to the model. Loosely speaking, small bias reflects the desire that if an experiment is…

Methodology · Statistics 2018-02-16 Ioannis Kosmidis

Modern datasets are characterized by a large number of features that may conceal complex dependency structures. To deal with this type of data, dimensionality reduction techniques are essential. Numerous dimensionality reduction methods…

Methodology · Statistics 2021-06-02 Francesco Denti , Diego Doimo , Alessandro Laio , Antonietta Mira

Visual insights into a wide variety of statistical methods, for both didactic and data analytic purposes, can often be achieved through geometric diagrams and geometrically based statistical graphs. This paper extols and illustrates the…

Methodology · Statistics 2013-02-21 Michael Friendly , Georges Monette , John Fox

We construct the entropic measure $\mathbb{P}^\beta$ on compact manifolds of any dimension. It is defined as the push forward of the Dirichlet process (another random probability measure, well-known to exist on spaces of any dimension)…

Probability · Mathematics 2009-01-14 Karl-Theodor Sturm

Distortion is widely existed in the images captured by popular wide-angle cameras and fisheye cameras. Despite the long history of distortion rectification, accurately estimating the distortion parameters from a single distorted image is…

Computer Vision and Pattern Recognition · Computer Science 2024-04-30 Kang Liao , Chunyu Lin , Yao Zhao

Valid estimation of treatment effects from observational data requires proper control of confounding. If the number of covariates is large relative to the number of observations, then controlling for all available covariates is infeasible.…

Methodology · Statistics 2018-01-11 Joseph Antonelli , Matthew Cefalu , Nathan Palmer , Denis Agniel

Reliable data-driven estimation of Shannon entropy from small data sets, where the number of examples is potentially smaller than the number of possible outcomes, is a critical matter in several applications. In this paper, we introduce a…

Machine Learning · Computer Science 2025-12-12 Gabriel F. A. Bastos , Jugurta Montalvão

Structural seismic interpretation and quantitative characterization are historically intertwined processes. The latter provides estimates of properties of the subsurface which can be used to aid structural interpretation alongside the…

Geophysics · Physics 2021-10-13 Matteo Ravasi , Claire Emma Birnie

Estimation and inference in dynamic discrete choice models often relies on approximation to lower the computational burden of dynamic programming. Unfortunately, the use of approximation can impart substantial bias in estimation and results…

Econometrics · Economics 2020-10-23 Ben Deaner

Detecting and measuring confounding effects from data is a key challenge in causal inference. Existing methods frequently assume causal sufficiency, disregarding the presence of unobserved confounding variables. Causal sufficiency is both…

Artificial Intelligence · Computer Science 2024-09-27 Abbavaram Gowtham Reddy , Vineeth N Balasubramanian

We give two low-complexity algorithms, one for dimensionality reduction and one for dimensionality increase, which are applicable to any dataset, regardless of whether the set has an intrinsic dimension or not. The corresponding methods…

General Mathematics · Mathematics 2025-12-16 Nicholas J. Daras

Modern large-scale datasets are frequently said to be high-dimensional. However, their data point clouds frequently possess structures, significantly decreasing their intrinsic dimensionality (ID) due to the presence of clusters, points…

Machine Learning · Computer Science 2019-01-21 Luca Albergante , Jonathan Bac , Andrei Zinovyev

Experimental measurements of physical systems often have a limited number of independent channels, causing essential dynamical variables to remain unobserved. However, many popular methods for unsupervised inference of latent dynamics from…

Machine Learning · Computer Science 2020-10-23 William Gilpin

This paper introduces a comprehensive framework for complex-valued probability measures and explores their novel applications in information theory and statistical analysis. We define a complex probability measure as a phase-modulated…

Information Theory · Computer Science 2026-03-16 Siang Cheng , Hejun Xu , Tianxiao Pang

This paper introduces a new fundamental characteristic, \ie, the dynamic range, from real-world metric tools to deep visual recognition. In metrology, the dynamic range is a basic quality of a metric tool, indicating its flexibility to…

Computer Vision and Pattern Recognition · Computer Science 2021-03-23 Yifan Sun , Yuke Zhu , Yuhan Zhang , Pengkun Zheng , Xi Qiu , Chi Zhang , Yichen Wei

Mutual information (MI) is a fundamental measure of statistical dependence between two variables, yet accurate estimation from finite data remains notoriously difficult. No estimator is universally reliable, and common approaches fail in…

Data Analysis, Statistics and Probability · Physics 2025-10-02 Eslam Abdelaleem , K. Michael Martini , Ilya Nemenman

Estimating causal effects is vital for decision making. In standard causal effect estimation, treatments are usually binary- or continuous-valued. However, in many important real-world settings, treatments can be structured,…

Machine Learning · Statistics 2024-12-02 Oriol Corcoll Andreu , Athanasios Vlontzos , Michael O'Riordan , Ciaran M. Gilligan-Lee

The maximum entropy method has been used to reconstruct images in a wide range of astronomical fields, but in its traditional form it is restricted to the reconstruction of strictly positive distributions. We present an extension of the…

Astrophysics · Physics 2009-10-31 MP Hobson , AN Lasenby

Dynamic discrete choice models often discretize the state vector and restrict its dimension in order to achieve valid inference. I propose a novel two-stage estimator for the set-identified structural parameter that incorporates a…

Econometrics · Economics 2018-11-07 Vira Semenova