English
Related papers

Related papers: Edgeworth Expansion for Semi-hard Triplet Loss

200 papers

Semiclassical dispersion corrections developed by Grimme and coworkers have become indispensable in applications of Kohn-Sham density functional theory. We present an in-depth assessment of the fit parameters present in semiclassical…

Chemical Physics · Physics 2018-05-15 Thomas Weymuth , Jonny Proppe , Markus Reiher

In this paper, we consider the sphericity test for a one-sample problem under high-dimensional two-step monotone incomplete data. Existing asymptotic expansions for the null distributions of the likelihood ratio test (LRT) statistic and…

Statistics Theory · Mathematics 2026-04-01 Tetsuya Sato , Tomoyuki Nakagawa

We develop generalized approach to obtaining Edgeworth expansions for $t$-statistics of an arbitrary order using computer algebra and combinatorial algorithms. To incorporate various versions of mean-based statistics, we introduce Adjusted…

Statistics Theory · Mathematics 2021-05-18 Inna Gerlovina , Alan E. Hubbard

The triplet loss with semi-hard negatives has become the de facto choice for image-caption retrieval (ICR) methods that are optimized from scratch. Recent progress in metric learning has given rise to new loss functions that outperform the…

Computer Vision and Pattern Recognition · Computer Science 2022-02-16 Maurits Bleeker , Maarten de Rijke

In the first part of this study, a convex-constrained penalized formulation was studied for a class of constant modulus (CM) problems. In particular, the error bound techniques were shown to play a vital role in providing exact penalization…

Signal Processing · Electrical Eng. & Systems 2024-11-12 Junbin Liu , Ya Liu , Wing-Kin Ma , Mingjie Shao , Anthony Man-Cho So

This paper focuses on inhomogeneous quadratic tests, which involve the sum of a dependent non-central chi-square with a Gaussian random variable. Unfortunately, no closed-form expression is available for the statistical distribution of the…

Applications · Statistics 2018-10-12 Daniel Egea-Roca , Gonzalo Seco-Granados , José A. López-Salcedo

Edgeworth-type expansions for convolutions of probability densities and powers of the characteristic functions with non-uniform error terms are established for i.i.d. random variables with finite (fractional) moments of order $s \geq 2$,…

Probability · Mathematics 2011-04-20 S. G. Bobkov , G. P. Chistyakov , F. Götze

This study investigates the fundamental limits of variable-length compression in which prefix-free constraints are not imposed (i.e., one-to-one codes are studied) and non-vanishing error probabilities are permitted. Due in part to a…

Information Theory · Computer Science 2021-10-05 Yuta Sakai , Recep Can Yavas , Vincent Y. F. Tan

Recent theoretical results show that gradient descent on deep neural networks under exponential loss functions locally maximizes classification margin, which is equivalent to minimizing the norm of the weight matrices under margin…

Machine Learning · Computer Science 2021-07-22 Andrzej Banburski , Fernanda De La Torre , Nishka Pant , Ishana Shastri , Tomaso Poggio

In statistical mechanics, evaluating finite-size macroscopic fluctuations typically relies on Edgeworth expansions. However, these perturbative methods append additive polynomial corrections that inevitably break down in the large deviation…

Information Theory · Computer Science 2026-04-15 Hiroki Suyari

In this article, we construct semiparametrically efficient estimators of linear functionals of a probability measure in the presence of side information using an easy empirical likelihood approach. We use estimated constraint functions and…

Methodology · Statistics 2023-03-01 Shan Wang , Hanxiang Peng

A sum of observations derived by a simple random sampling design from a population of independent random variables is studied. A procedure finding a general term of Edgeworth asymptotic expansion is presented. The Lindeberg condition of…

Statistics Theory · Mathematics 2013-12-12 Ibrahim Bin Mohamed , Sherzod M. Mirakhmedov

Consider the matrix products $G_n: = g_n \ldots g_1$, where $(g_{n})_{n\geq 1}$ is a sequence of independent and identically distributed positive random $d\times d$ matrices. Under the optimal third moment condition, we first establish a…

Probability · Mathematics 2025-02-20 Hui Xiao , Ion Grama , Quansheng Liu

We develop a class of non-Gaussian translation processes that extend classical stochastic differential equations (SDEs) by prescribing arbitrary absolutely continuous marginal distributions. Our approach uses a copula-based transformation…

Statistics Theory · Mathematics 2025-08-06 Robert Richardson , H. Dennis Tolley , Kenneth Kuttler

Learning from triplet comparison data has been extensively studied in the context of metric learning, where we want to learn a distance metric between two instances, and ordinal embedding, where we want to learn an embedding in an Euclidean…

Machine Learning · Computer Science 2020-04-21 Zhenghang Cui , Nontawat Charoenphakdee , Issei Sato , Masashi Sugiyama

The paper considers an Euler discretization based numerical scheme for approximating functionals of invariant distribution of an ergodic diffusion. Convergence of the numerical scheme is shown for suitably chosen discretization step, and a…

Probability · Mathematics 2018-05-31 Arnab Ganguly , P. Sundar

The problem of regression extrapolation, or out-of-distribution generalization, arises when predictions are required at test points outside the range of the training data. In such cases, the non-parametric guarantees for regression methods…

Methodology · Statistics 2024-10-31 Gloria Buriticá , Sebastian Engelke

The classical asymptotic theory for parametric $M$-estimators guarantees that, in the limit of infinite sample size, the excess risk has a chi-square type distribution, even in the misspecified case. We demonstrate how self-concordance of…

Statistics Theory · Mathematics 2020-12-01 Dmitrii Ostrovskii , Francis Bach

The paper presents a novel asymptotic distribution for a mle when the log--likelihood is strictly concave in the parameter for all data points; for example, the exponential family. The new asymptotic distribution can be seen as a refinement…

Statistics Theory · Mathematics 2021-06-15 Stephen G Walker

The purpose of this article is to develop a general parametric estimation theory that allows the derivation of the limit distribution of estimators in non-regular models where the true parameter value may lie on the boundary of the…

Statistics Theory · Mathematics 2022-11-28 Junichiro Yoshida , Nakahiro Yoshida