English
Related papers

Related papers: On Euclidean Norm Approximations

200 papers

Stochastic approximation is a foundation for many algorithms found in machine learning and optimization. It is in general slow to converge: the mean square error vanishes as $O(n^{-1})$. A deterministic counterpart known as quasi-stochastic…

Optimization and Control · Mathematics 2024-03-26 Caio Kalil Lauand , Sean Meyn

We investigate the approximation for computing the sum $a_1+...+a_n$ with an input of a list of nonnegative elements $a_1,..., a_n$. If all elements are in the range $[0,1]$, there is a randomized algorithm that can compute an…

Data Structures and Algorithms · Computer Science 2012-03-01 Bin Fu , Wenfeng Li , Zhiyong Peng

We examine the problem of construction of confidence intervals within the basic single-parameter, single-iteration variation of the method of quasi-optimal weights. Two kinds of distortions of such intervals due to insufficiently large…

Data Analysis, Statistics and Probability · Physics 2020-05-27 A. D. Morozov , A. V. Lokhov , F. V. Tkachov

In this article we present very intuitive, easy to follow, yet mathematically rigorous, approach to the so called data fitting process. Rather than minimizing the distance between measured and simulated data points, we prefer to find such…

Data Analysis, Statistics and Probability · Physics 2017-08-07 Marek W. Gutowski

In systematic reviews and meta-analysis, researchers often pool the results of the sample mean and standard deviation from a set of similar clinical trials. A number of the trials, however, reported the study using the median, the minimum…

Methodology · Statistics 2016-10-06 Xiang Wan , Wenqian Wang , Jiming Liu , Tiejun Tong

This paper presents a detailed theoretical analysis of the three stochastic approximation proximal gradient algorithms proposed in our companion paper [49] to set regularization parameters by marginal maximum likelihood estimation. We prove…

Statistics Theory · Mathematics 2020-08-14 Valentin De Bortoli , Alain Durmus , Ana F. Vidal , Marcelo Pereyra

We show that computing even very coarse approximations of critical points is intractable for simple classes of nonconvex functions. More concretely, we prove that if there exists a polynomial-time algorithm that takes as input a polynomial…

Optimization and Control · Mathematics 2026-01-30 Amir Ali Ahmadi , Georgina Hall

Calibration allows predictions to be reliably interpreted as probabilities by decision makers. We propose a decision-theoretic calibration error, the Calibration Decision Loss (CDL), defined as the maximum improvement in decision payoff…

Machine Learning · Computer Science 2024-10-14 Lunjia Hu , Yifan Wu

We study an optimization problem with the feasible set being a real algebraic variety $X$ and whose parametric objective function $f_u$ is gradient-solvable with respect to the parametric data $u$. This class of problems includes Euclidean…

Algebraic Geometry · Mathematics 2021-05-18 Kaie Kubjas , Olga Kuznetsova , Luca Sodomaco

The objective of ordinal embedding is to find a Euclidean representation of a set of abstract items, using only answers to triplet comparisons of the form "Is item $i$ closer to the item $j$ or item $k$?". In recent years, numerous…

Machine Learning · Computer Science 2021-10-22 Leena Chennuru Vankadara , Siavash Haghiri , Michael Lohaus , Faiz Ul Wahab , Ulrike von Luxburg

Distance measuring is a very important task in digital geometry and digital image processing. Due to our natural approach to geometry we think of the set of points that are equally far from a given point as a Euclidean circle. Using the…

Metric Geometry · Mathematics 2010-06-18 Janos Farkas , Szabolcs Bajak , Benedek Nagy

We consider a set of Euclidean optimization problems in one dimension, where the cost function associated to the couple of points $x$ and $y$ is the Euclidean distance between them to an arbitrary power $p\ge1$, and the points are chosen at…

Disordered Systems and Neural Networks · Physics 2019-10-07 Sergio Caracciolo , Andrea Di Gioacchino , Enrico M. Malatesta , Luca G. Molinari

The paper suggests a new --- to the best of the author's knowledge --- characterization of decisions which are optimal in the multi-objective optimization problem with respect to a definite proper preference cone, a Euclidean cone with a…

Optimization and Control · Mathematics 2014-01-10 A. Y. Golubin

The matching problem is a notorious combinatorial optimization problem that has attracted for many years the attention of the statistical physics community. Here we analyze the Euclidean version of the problem, i.e. the optimal matching…

Disordered Systems and Neural Networks · Physics 2017-01-11 Carlo Lucibello , Giorgio Parisi , Gabriele Sicuro

In this paper we present an algorithm to fit data via exponentials when the error is measured using the max-norm. We prove the necesssary results to show that the algorithm will converge to the best approximation no matter the dataset.

We present and study approximate notions of dimensional and margin complexity, which correspond to the minimal dimension or norm of an embedding required to approximate, rather then exactly represent, a given hypothesis class. We show that…

Machine Learning · Computer Science 2020-03-10 Pritish Kamath , Omar Montasser , Nathan Srebro

A classical result of Johnson and Lindenstrauss states that a set of $n$ high dimensional data points can be projected down to $O(\log n/\epsilon^2)$ dimensions such that the square of their pairwise distances is preserved up to a small…

Data Structures and Algorithms · Computer Science 2023-06-02 Aleksandros Sobczyk , Mathieu Luisier

In this work, we present a generic step-size choice for the ADMM type proximal algorithms. It admits a closed-form expression and is theoretically optimal with respect to a worst-case convergence rate bound. It is simply given by the ratio…

Optimization and Control · Mathematics 2023-06-26 Yifan Ran , Wei Dai

Consider a quite arbitrary (semi)parametric model with a Euclidean parameter of interest and assume that an asymptotically (semi)parametrically efficient estimator of it is given. If the parameter of interest is known to lie on a general…

Statistics Theory · Mathematics 2015-08-17 Chris A. J. Klaassen , Nanang Susyanto

Coherent lower previsions are general probabilistic models allowing incompletely specified probability distributions. However, for complete description of a coherent lower prevision -- even on finite underlying sample spaces -- an infinite…

Probability · Mathematics 2022-09-29 Damjan Škulj
‹ Prev 1 3 4 5 6 7 10 Next ›