English
Related papers

Related papers: Reformulating the Kriging Algorithm to the Practic…

200 papers

This paper aims to motivate stochastic optimization problems from a statistical perspective and a statistical learning perspective, where the goal is to maximize the log-likelihood or minimize the population risk. We briefly describe the…

Optimization and Control · Mathematics 2026-05-19 Arutyun Avetisyan , Darina Dvinskikh , Alexander Gasnikov , Vladimir Temlyakov , Nazarii Tupitsa , Denis Turdakov

These notes provide an introduction to the algebra and geometry of differential operators and jet bundles. Their point of view is guided by the leitmotiv that higher-spin gravity theories call for higher-order generalisations of Lie…

High Energy Physics - Theory · Physics 2023-06-28 Xavier Bekaert

An important problem in geostatistics is to build models of the subsurface of the Earth given physical measurements at sparse spatial locations. Typically, this is done using spatial interpolation methods or by reproducing patterns from a…

Machine Learning · Statistics 2018-07-06 Emilien Dupont , Tuanfeng Zhang , Peter Tilke , Lin Liang , William Bailey

This article discusses the application of stochastic intervention to find the optimal treatment distribution yielding a high value of expected potential outcome under the setting where the number of treatments is allowed to vary with $n$.…

Statistics Theory · Mathematics 2026-04-22 Rohit Chaudhuri

The objectives of this technical report is to provide additional results on the generalized conditional gradient methods introduced by Bredies et al. [BLM05]. Indeed , when the objective function is smooth, we provide a novel certificate of…

Machine Learning · Computer Science 2015-11-20 Alain Rakotomamonjy , Rémi Flamary , Nicolas Courty

Stochastic optimization methods have been hugely successful in making large-scale optimization problems feasible when computing the full gradient is computationally prohibitive. Using the theory of modified equations for numerical…

Optimization and Control · Mathematics 2023-09-06 Stefano Di Giovacchino , Desmond J. Higham , Konstantinos Zygalakis

Diffusions are a successful technique to sample from high-dimensional distributions. The target distribution can be either explicitly given or learnt from a collection of samples. They implement a diffusion process whose endpoint is a…

Machine Learning · Computer Science 2025-09-03 Andrea Montanari

Genetic Algorithm (GA) is a popular meta-heuristic evolutionary algorithm that uses stochastic operators to find optimal solution and has proved its effectiveness in solving many complex optimization problems (such as classification,…

Neural and Evolutionary Computing · Computer Science 2023-05-02 Fahad Maqbool , Muhammad Saad Razzaq , Hajira Jabeen

We consider stochastic settings for clustering, and develop provably-good approximation algorithms for a number of these notions. These algorithms yield better approximation ratios compared to the usual deterministic clustering setting.…

Data Structures and Algorithms · Computer Science 2023-10-13 David G. Harris , Shi Li , Thomas Pensyl , Aravind Srinivasan , Khoa Trinh

Regression methods dominate the practice of biostatistical analysis, but biostatistical training emphasises the details of regression models and methods ahead of the purposes for which such modelling might be useful. More broadly,…

Methodology · Statistics 2024-09-12 John B. Carlin , Margarita Moreno-Betancur

The work relates to a new way for analysis of one-dimensional stochastic systems, based on consideration of its higher order difference structure. From this point of view, the deterministic and random processes are analyzed. A new numerical…

Chaotic Dynamics · Physics 2016-09-08 A. Yu. Shahverdian , A. V. Apkarian

The lifetime of statistical system is introduced. It is supposed that the nonequilibrium statistical operator implicitly contains the lifetime. The operations of taking of invariant part, averaging on initial conditions used in works of…

Statistical Mechanics · Physics 2011-11-17 V. V. Ryazanov

Gaussianizing transformations are used statistically in many non-cosmological fields, but in cosmology, we are only starting to apply them. Here I explain a strategy of analyzing the 1-point function (PDF) of a spatial field, together with…

Cosmology and Nongalactic Astrophysics · Physics 2014-07-22 Mark C. Neyrinck

In this paper we present a general framework for Stein's method for multivariate continuous distributions. The approach gives a collection of Stein characterisations, among which we highlight score-Stein operators and kernel Stein…

Probability · Mathematics 2019-11-14 Guillaume Mijoule , Gesine Reinert , Yvik Swan

The operations of linear algebra, calculus, and statistics are routinely applied to measurement scales but certain mathematical conditions must be satisfied in order for these operations to be applicable. We call attention to the conditions…

General Mathematics · Mathematics 2007-05-23 Jonathan Barzilai

In this work, we study an optimizer, Grad-Avg to optimize error functions. We establish the convergence of the sequence of iterates of Grad-Avg mathematically to a minimizer (under boundedness assumption). We apply Grad-Avg along with some…

Machine Learning · Computer Science 2020-12-11 Saugata Purkayastha , Sukannya Purkayastha

This paper deals with (globally) random substitutions on a finite set of prototiles. Using renormalization tools applied to objects from operator algebras we establish upper and lower bounds on the rate of deviations of ergodic averages for…

Dynamical Systems · Mathematics 2023-05-26 Rodrigo Treviño

Despite widespread interest and practical use, the theoretical properties of random forests are still not well understood. In this paper we contribute to this understanding in two ways. We present a new theoretically tractable variant of…

Machine Learning · Statistics 2013-10-08 Misha Denil , David Matheson , Nando de Freitas

The Random Geometric Graph (RGG) is a random graph model for network data with an underlying spatial representation. Geometry endows RGGs with a rich dependence structure and often leads to desirable properties of real-world networks such…

Social and Information Networks · Computer Science 2022-08-25 Quentin Duchemin , Yohann de Castro

The statement of the mean field approximation theorem in the mean field theory of Markov processes particularly targets the behaviour of population processes with an unbounded number of agents. However, in most real-world engineering…

Probability · Mathematics 2017-05-11 Mahmoud Talebi , Jan Friso Groote , Jean-Paul Linnartz