English
Related papers

Related papers: Approximating the covariance ellipsoid

200 papers

We derive the form of the variance-covariance matrix for any affine equivariant matrix-valued statistics when sampling from complex elliptical distributions. We then use this result to derive the variance-covariance matrix of the sample…

Statistics Theory · Mathematics 2021-11-10 Elias Raninen , Esa Ollila , David E. Tyler

The issue of a "mean shape" of a random set $X$ often arises, in particular in image analysis and pattern detection. There is no canonical definition but one possible approach is the so-called Vorob'ev expectation $\E_V(X)$, which is…

Probability · Mathematics 2012-11-27 Philippe Heinrich , Radu Stefan Stoica , Viet Chi Tran

In this work we consider the problem of fitting Random Utility Models (RUMs) to user choices. Given the winner distributions of the subsets of size $k$ of a universe, we obtain a polynomial-time algorithm that finds the RUM that best…

Machine Learning · Computer Science 2023-05-23 Flavio Chierichetti , Mirko Giacchini , Ravi Kumar , Alessandro Panconesi , Andrew Tomkins

Chance constraints describe a set of given random inequalities depending on the decision vector satisfied with a large enough probability. They are widely used in decision making under uncertain data in many engineering problems. This paper…

Optimization and Control · Mathematics 2025-04-01 Heng Zhang , Abdel Lisser

Subgradient algorithms for training support vector machines have been quite successful for solving large-scale and online learning problems. However, they have been restricted to linear kernels and strongly convex formulations. This paper…

Machine Learning · Computer Science 2011-11-04 Sangkyun Lee , Stephen J. Wright

This work introduces the nested-set Hessian approximation, a second-order approximation method that can be used in any derivative-free optimization routine that requires such information. It is built on the foundation of the generalized…

Optimization and Control · Mathematics 2020-11-06 Warren Hare , Gabriel Jarry-Bolduc , Chayne Planiden

This paper addresses the fundamental question of when convex sets remain disjoint after random projection. We provide an analysis using ideas from high-dimensional convex geometry. For ellipsoids, we provide a bound in terms of the distance…

Machine Learning · Computer Science 2014-04-14 Afonso S. Bandeira , Dustin G. Mixon , Benjamin Recht

Let $\Lambda \subset \mathbb R^n$ be an algebraic lattice, coming from a projective module over the ring of integers of a number field $K$. Let $\mathcal Z \subset \mathbb R^n$ be the zero locus of a finite collection of polynomials such…

Number Theory · Mathematics 2018-02-01 Lenny Fukshansky , Nikolay Moshchevitin

Approximate Bayesian Computation (ABC) enables statistical inference in simulator-based models whose likelihoods are difficult to calculate but easy to simulate from. ABC constructs a kernel-type approximation to the posterior distribution…

Methodology · Statistics 2022-12-02 Yuexi Wang , Tetsuya Kaji , Veronika Ročková

Given any domain $X\subseteq \mathbb{R}^d$ and a probability measure $\rho$ on $X$, we study the problem of approximating in $L^2(X,\rho)$ a given function $u:X\to\mathbb{R}$, using its noiseless pointwise evaluations at random samples. For…

Numerical Analysis · Mathematics 2019-07-11 Giovanni Migliorati

This paper proposes an algorithm to generate random numbers from any member of the truncated multivariate elliptical family of distributions with a strictly decreasing density generating function. Based on Neal (2003) and Ho et al. (2012),…

Computation · Statistics 2021-12-20 Katherine A. L. Valeriano , Christian E. Galarza , Larissa A. Matos

We discuss how the kernel convolution approach can be used to accurately approximate the spatial covariance model on a sphere using spherical distances between points. A detailed derivation of the required formulas is provided. The proposed…

Computation · Statistics 2017-01-13 Alexander Gribov , Konstantin Krivoruchko

Consider a $d\times d$ matrix $M$ whose rows are independent centered non-degenerate Gaussian vectors $\xi_1,...,\xi_d$ with covariance matrices $\Sigma_1,...,\Sigma_d$. Denote by $\mathcal{E}_i$ the location-dispersion ellipsoid of…

Probability · Mathematics 2012-06-05 Zakhar Kabluchko , Dmitry Zaporozhets

Variational mean field approximations tend to struggle with contemporary overparametrized deep neural networks. Where a Bayesian treatment is usually associated with high-quality predictions and uncertainties, the practical reality has been…

We introduce two versions of a new sketch for approximately embedding the Gaussian kernel into Euclidean inner product space. These work by truncating infinite expansions of the Gaussian kernel, and carefully invoking the…

Machine Learning · Computer Science 2020-06-22 Jeff M. Phillips , Wai Ming Tai

To overcome these obstacles and improve computational accuracy and efficiency, this paper presents the Randomized Radial Basis Function Neural Network (RRNN), an innovative approach explicitly crafted for solving multiscale elliptic…

Numerical Analysis · Mathematics 2024-07-23 Yuhang Wu , Ziyuan Liu , Wenjun Sun , Xu Qian

The article considers minimization of the expectation of convex function. Problems of this type often arise in machine learning and a number of other applications. In practice, stochastic gradient descent (SGD) and similar procedures are…

Optimization and Control · Mathematics 2020-11-10 Egor Gladin , Karina Zaynullina

The first step in elliptic curve scalar multiplication algorithms based on scalar decompositions using efficient endomorphisms-including Gallant-Lambert-Vanstone (GLV) and Galbraith-Lin-Scott (GLS) multiplication, as well as…

Number Theory · Mathematics 2013-10-22 Benjamin Smith

We consider the problem of subset selection for $\ell_{p}$ subspace approximation, i.e., given $n$ points in $d$ dimensions, we need to pick a small, representative subset of the given points such that its span gives $(1+\epsilon)$…

Computational Geometry · Computer Science 2021-03-23 Amit Deshpande , Rameshwar Pratap

Bayesian model selection provides the cosmologist with an exacting tool to distinguish between competing models based purely on the data, via the Bayesian evidence. Previous methods to calculate this quantity either lacked general…

Astrophysics · Physics 2008-11-26 J. R. Shaw , M. Bridges , M. P. Hobson