English
Related papers

Related papers: Asymptotic Granularity Reduction and Its Applicati…

200 papers

In this research monograph, we deal with a very general asymptotic representation for statistics named GRI expressed in the functional empirical process, both one-dimensional and multidimensional, and another call residual empirical…

Trust-region (TR) and adaptive regularization using cubics (ARC) have proven to have some very appealing theoretical properties for non-convex optimization by concurrently computing function value, gradient, and Hessian matrix to obtain the…

Machine Learning · Computer Science 2023-10-19 Liu Liu , Xuanqing Liu , Cho-Jui Hsieh , Dacheng Tao

Gaussian Processes (GPs) are a popular approach to predict the output of a parameterized experiment. They have many applications in the field of Computer Experiments, in particular to perform sensitivity analysis, adaptive design of…

Optimization and Control · Mathematics 2017-05-08 Hossein Mohammadi , Rodolphe Le Riche , Nicolas Durrande , Eric Touboul , Xavier Bay

In this paper, by employing the asymptotic expansion method, we prove the existence and uniqueness of a smoothing solution for a time-dependent nonlinear singularly perturbed partial differential equation (PDE) with a small-scale parameter.…

Numerical Analysis · Mathematics 2022-10-11 Dmitrii Chaikovskii , Ye Zhang

The angular measure on the unit sphere characterizes the first-order dependence structure of the components of a random vector in extreme regions and is defined in terms of standardized margins. Its statistical recovery is an important step…

Statistics Theory · Mathematics 2024-07-16 Stéphane Lhaut , Johan Segers

The adjoint method is an efficient way to numerically compute gradients in optimization problems with constraints, but is only formulated to differentiable cost and constraint functions on real variables. With the introduction of complex…

Optimization and Control · Mathematics 2026-01-21 Andrew Zheng , Adam R. Stinchcombe

We consider convolution integral equations on a finite interval with a real-valued kernel of even parity, a problem equivalent to finding a Wiener-Hopf factorisation of a notoriously difficult class of $2\times 2$ matrices. The kernel…

Spectral Theory · Mathematics 2021-06-09 Dmitry Ponomarev

In this note, we are concerned with the asymptotic approximation of a class of double integrals which can be represented as an angular spectrum superposition. These double integrals typically appear in electromagnetic scattering problems.…

Mathematical Physics · Physics 2007-05-23 Fei Wang

Synthetic Aperture Radar (SAR) Automatic Target Recognition (ATR) is the key technique for remote sensing image recognition. The state-of-the-art works exploit the deep convolutional neural networks (CNNs) for SAR ATR, leading to high…

Computer Vision and Pattern Recognition · Computer Science 2023-05-15 Bingyi Zhang , Sasindu Wijeratne , Rajgopal Kannan , Viktor Prasanna , Carl Busart

The two point angular correlation function is an excellent measure of structure in the universe. To extract from it the three dimensional power spectrum, one must invert Limber's Equation. Here we perform this inversion using a Bayesian…

Astrophysics · Physics 2008-11-26 Scott Dodelson , Enrique Gaztanaga

Consider estimation of the regression function based on a model with equidistant design and measurement errors generated from a fractional Gaussian noise process. In previous literature, this model has been heuristically linked to an…

Statistics Theory · Mathematics 2014-12-02 Johannes Schmidt-Hieber

We apply the functional Renormalisation Group (fRG) to study relaxation in a stochastic process governed by an overdamped Langevin equation with one degree of freedom, exploiting the connection with supersymmetric quantum mechanics in…

Statistical Mechanics · Physics 2023-06-06 Ashley Wilkins , Gerasimos Rigopoulos , Enrico Masoero

Gaussian Process (GP) regression is a flexible non-parametric approach to approximate complex models. In many cases, these models correspond to processes with bounded physical properties. Standard GP regression typically results in a proxy…

Machine Learning · Computer Science 2020-04-10 Andrew Pensoneault , Xiu Yang , Xueyu Zhu

Nonlinear parametric inverse problems appear in many applications and are typically very expensive to solve, especially if they involve many measurements. These problems pose huge computational challenges as evaluating the objective…

Numerical Analysis · Mathematics 2020-03-25 Drayton Munster , Eric de Sturler

Stochastic gradient descent~(SGD) and its variants have become more and more popular in machine learning due to their efficiency and effectiveness. To handle large-scale problems, researchers have recently proposed several parallel SGD…

Machine Learning · Statistics 2015-08-25 Shen-Yi Zhao , Wu-Jun Li

We carry out the asymptotic analysis as $n \to \infty$ of a class of orthogonal polynomials $p_{n}(z)$ of degree $n$, defined with respect to the planar measure \begin{equation*} d\mu(z) = (1-|z|^{2})^{\alpha-1}|z-x|^{\gamma}\mathbf{1}_{|z|…

Mathematical Physics · Physics 2025-06-09 Alfredo Deaño , Kenneth T-R McLaughlin , Leslie Molag , Nick Simm

Gaussian Process (GP) models are a powerful tool in probabilistic machine learning with a solid theoretical foundation. Thanks to current advances, modeling complex data with GPs is becoming increasingly feasible, which makes them an…

Machine Learning · Computer Science 2025-03-04 Sarem Seitz

Injecting artificial noise into gradient descent (GD) is commonly employed to improve the performance of machine learning models. Usually, uncorrelated noise is used in such perturbed gradient descent (PGD) methods. It is, however, not…

Machine Learning · Statistics 2023-05-22 Antonio Orvieto , Hans Kersting , Frank Proske , Francis Bach , Aurelien Lucchi

This paper derives asymptotic theory for Breitung's (2002, Journal of Econometrics 108, 343-363) nonparameteric variance ratio unit root test when applied to regression residuals. The test requires neither the specification of the…

Econometrics · Economics 2025-10-10 Karsten Reichold

Despite the wide applications of Adam in reinforcement learning (RL), the theoretical convergence of Adam-type RL algorithms has not been established. This paper provides the first such convergence analysis for two fundamental RL algorithms…

Machine Learning · Computer Science 2020-08-18 Huaqing Xiong , Tengyu Xu , Yingbin Liang , Wei Zhang