English
Related papers

Related papers: On the error estimate of gradient inclusions

200 papers

The implicit boundary integral method (IBIM) provides a framework to construct quadrature rules on regular lattices for integrals over irregular domain boundaries. This work provides a systematic error analysis for IBIMs on uniform…

Numerical Analysis · Mathematics 2023-12-14 Yimin Zhong , Kui Ren , Olof Runborg , Richard Tsai

In this paper we are concerned with a sequence of univariate random variables with piecewise polynomial means and independent sub-Gaussian noise. The underlying polynomials are allowed to be of arbitrary but fixed degrees. All the other…

Statistics Theory · Mathematics 2022-02-03 Yi Yu , Sabyasachi Chatterjee , Haotian Xu

By providing a simple and efficient way of computing low-variance gradients of continuous random variables, the reparameterization trick has become the technique of choice for training a variety of latent variable models. However, it is not…

Machine Learning · Computer Science 2019-01-31 Michael Figurnov , Shakir Mohamed , Andriy Mnih

This article explores the estimation of precision matrices in high-dimensional Gaussian graphical models. We address the challenge of improving the accuracy of maximum likelihood-based precision estimation through penalization.…

Methodology · Statistics 2023-12-27 A. Bekker , A. Kheyri , M. Arashi

Modern large-scale statistical models require to estimate thousands to millions of parameters. This is often accomplished by iterative algorithms such as gradient descent, projected gradient descent or their accelerated versions. What are…

Machine Learning · Statistics 2020-03-04 Michael Celentano , Andrea Montanari , Yuchen Wu

Let $(\Sigma, g)$ be a closed Riemann surface, and let $u$ be a weak solution to equation \[ - \Delta_g u = \mu, \] where $\mu$ is a signed Radon measure. We aim to establish $L^p$ estimates for the gradient of $u$ that are independent of…

Differential Geometry · Mathematics 2025-10-15 Yuxiang Li , Rongze Sun

A fundamental task in numerical computation is the solution of large linear systems. The conjugate gradient method is an iterative method which offers rapid convergence to the solution, particularly when an effective preconditioner is…

Methodology · Statistics 2018-12-18 Jon Cockayne , Chris Oates , Ilse Ipsen , Mark Girolami

Estimates of image gradients play a ubiquitous role in image segmentation and classification problems since gradients directly relate to the boundaries or the edges of a scene. This paper proposes an unified approach to gradient estimation…

Computer Vision and Pattern Recognition · Computer Science 2016-05-10 Anish Acharya , Uddipan Mukherjee , Charless Fowlkes

In this paper we study convergence estimates for a multigrid algorithm with smoothers of successive subspace correction (SSC) type, applied to symmetric elliptic PDEs. First, we revisit a general convergence analysis on a class of multigrid…

Numerical Analysis · Mathematics 2018-05-09 Eugenio Aulisa , Giorgio Bornia , Sara Calandrini , Giacomo Capodaglio

We perform a smoothed analysis of the componentwise condition numbers for determinant computation, matrix inversion, and linear equations solving for sparse n times n matrices. The bounds we obtain for the ex- pectations of the logarithm of…

Numerical Analysis · Mathematics 2013-02-26 Dennis Cheung , Felipe Cucker

Low-rank matrix completion concerns the problem of estimating unobserved entries in a matrix using a sparse set of observed entries. We consider the non-uniform setting where the observed entries are sampled with highly varying…

Machine Learning · Statistics 2024-03-04 Xumei Xi , Christina Lee Yu , Yudong Chen

Low-rank matrix estimation is a canonical problem that finds numerous applications in signal processing, machine learning and imaging science. A popular approach in practice is to factorize the matrix into two compact low-rank factors, and…

Machine Learning · Computer Science 2021-06-16 Tian Tong , Cong Ma , Yuejie Chi

The conjugate gradient method is a widely used algorithm for the numerical solution of a system of linear equations. It is particularly attractive because it allows one to take advantage of sparse matrices and produces (in case of infinite…

Numerical Analysis · Mathematics 2017-11-27 Sergey Voronin , Christophe Zaroli , Naresh P. Cuntoor

The paper looks at a scaled variant of the stochastic gradient descent algorithm for the matrix completion problem. Specifically, we propose a novel matrix-scaling of the partial derivatives that acts as an efficient preconditioning for the…

Machine Learning · Computer Science 2016-10-06 Bamdev Mishra , Rodolphe Sepulchre

In this paper, we consider matrix completion with absolute deviation loss and obtain an estimator of the median matrix. Despite several appealing properties of median, the non-smooth absolute deviation loss leads to computational challenge…

Machine Learning · Statistics 2020-06-19 Weidong Liu , Xiaojun Mao , Raymond K. W. Wong

A common belief in high-dimensional data analysis is that data are concentrated on a low-dimensional manifold. This motivates simultaneous dimension reduction and regression on manifolds. We provide an algorithm for learning gradients on…

Statistics Theory · Mathematics 2010-02-24 Sayan Mukherjee , Qiang Wu , Ding-Xuan Zhou

This paper proposes an efficient probabilistic method that computes combinatorial gradient fields for two dimensional image data. In contrast to existing algorithms, this approach yields a geometric Morse-Smale complex that converges almost…

Computer Vision and Pattern Recognition · Computer Science 2012-09-03 Jan Reininghaus , David Günther , Ingrid Hotz , Tino Weinkauf , Hans Peter Seidel

Using the Moore--Penrose pseudoinverse, this work generalizes the gradient approximation technique called centred simplex gradient to allow sample sets containing any number of points. This approximation technique is called the…

Numerical Analysis · Mathematics 2020-06-02 Warren Hare , Gabriel Jarry--Bolduc , Chayne Planiden

We propose a two-step estimating procedure for generalized additive partially linear models with clustered data using estimating equations. Our proposed method applies to the case that the number of observations per cluster is allowed to…

Statistics Theory · Mathematics 2013-02-20 Shujie Ma

This paper is devoted to first-order algorithms for smooth convex optimization with inexact gradients. Unlike the majority of the literature on this topic, we consider the setting of relative rather than absolute inexactness. More…

Optimization and Control · Mathematics 2023-10-03 Nikita Kornilov , Eduard Gorbunov , Mohammad Alkousa , Fedor Stonyakin , Pavel Dvurechensky , Alexander Gasnikov