English
Related papers

Related papers: On the error estimate of gradient inclusions

200 papers

We establish the global gradient bounds for weak solutions to the elliptic variational inequality with two-sided obstructions, associated with a $p(x)$-Laplacian type operator involving degenerate or singular matrix weights. Under the…

Analysis of PDEs · Mathematics 2026-01-05 Minh-Phuong Tran , Duc-Quang Bui , Thanh-Nhan Nguyen

We study the generalization performance of unregularized gradient methods for separable linear classification. While previous work mostly deal with the binary case, we focus on the multiclass setting with $k$ classes and establish novel…

Machine Learning · Computer Science 2025-05-29 Matan Schliserman , Tomer Koren

This paper aims at achieving a "good" estimator for the gradient of a function on a high-dimensional space. Often such functions are not sensitive in all coordinates and the gradient of the function is almost sparse. We propose a method for…

Machine Learning · Statistics 2016-07-27 Vivek S. Borkar , Vikranth R. Dwaracherla , Neeraja Sahasrabudhe

Composite optimization problems involve minimizing the composition of a smooth map with a convex function. Such objectives arise in numerous data science and signal processing applications, including phase retrieval, blind deconvolution,…

Optimization and Control · Mathematics 2025-10-06 Mateo Díaz , Liwei Jiang , Abdel Ghani Labassi

The task of reconstructing a matrix given a sample of observedentries is known as the matrix completion problem. It arises ina wide range of problems, including recommender systems, collaborativefiltering, dimensionality reduction, image…

Statistics Theory · Mathematics 2014-12-20 Jean Lafond , Olga Klopp , Eric Moulines , Jospeh Salmon

This work is concerned with quasi-optimal a-priori finite element error estimates for the obstacle problem in the $L^2$-norm. The discrete approximations are introduced as solutions to a finite element discretization of an accordingly…

Numerical Analysis · Mathematics 2018-11-26 Dominik Hafemeyer , Christian Kahle , Johannes Pfefferer

We present a numerical method for rigorous over-approximation of a reachable set of differential inclusions. The method gives high-order error bounds for single step approximations and a uniform bound on the error over the finite time…

Classical Analysis and ODEs · Mathematics 2012-06-29 Sanja Gonzalez Zivanovic , Pieter Collins

We study both systematic and statistical errors in radiation density matrix measurements. First we estimate the minimum number of scanning phases needed to reduce systematic errors below a fixed threshold. Then, we calculate the statistical…

Quantum Physics · Physics 2009-10-30 G. M. D'Ariano , N. Sterpi , C. Macchiavello

We consider a class of stochastic gradient optimization schemes. Assuming that the objective function is strongly convex, we prove weak error estimates which are uniform in time for the error between the solution of the numerical scheme,…

Numerical Analysis · Mathematics 2026-01-27 Charles-Edouard Bréhier , Marc Dambrine , Nassim En-Nebbazi

The modeling of damage processes in materials constitutes an ill-posed mathematical problem which manifests in mesh-dependent finite element results. The loss of ellipticity of the discrete system of equations is counteracted by…

Computational Engineering, Finance, and Science · Computer Science 2021-02-18 Philipp Junker , Johannes Riesselmann , Daniel Balzani

Efforts to understand the generalization mystery in deep learning have led to the belief that gradient-based optimization induces a form of implicit regularization, a bias towards models of low "complexity." We study the implicit…

Machine Learning · Computer Science 2019-10-29 Sanjeev Arora , Nadav Cohen , Wei Hu , Yuping Luo

Optimization with noisy gradients has become ubiquitous in statistics and machine learning. Reparameterization gradients, or gradient estimates computed via the "reparameterization trick," represent a class of noisy gradients often used in…

Machine Learning · Statistics 2017-05-23 Andrew C. Miller , Nicholas J. Foti , Alexander D'Amour , Ryan P. Adams

We study the insulated conductivity problem with inclusions embedded in a bounded domain in $\mathbb R^n$, for $n \ge 3$. The gradient of solutions may blow up as $\varepsilon$, the distance between inclusions, approaches to $0$. We…

Analysis of PDEs · Mathematics 2022-04-07 Hongjie Dong , Yanyan Li , Zhuolun Yang

When two stiff inclusions are closely located, the gradient of the solution to the Lam\'{e} system, in other words the stress, may become arbitrarily large as the distance between two inclusions tends to zero. To compute the gradient of the…

Numerical Analysis · Mathematics 2024-07-10 Xiaofei Li , Shengqi Lin , Haojie Wang

In this paper, we propose a proximal gradient method and an accelerated proximal gradient method for solving composite optimization problems, where the objective function is the sum of a smooth and a convex, possibly nonsmooth, function. We…

Optimization and Control · Mathematics 2025-07-22 Raghu Bollapragada , Shagun Gupta

In this paper, we consider the dual formulation of minimizing $\sum_{i\in I}f_i(x_i)+\sum_{j\in J} g_j(\mathcal{A}_jx)$ with the index sets $I$ and $J$ being large. To address the difficulties from the high dimension of the variable $x$…

Optimization and Control · Mathematics 2020-09-03 Hui Zhang , Yu-Hong Dai , Lei Guo

We rewrite the standard nodal virtual element method as a generalised gradient method. This re-formulation allows for computing a reliable and efficient error estimator by locally reconstructing broken fluxes and potentials on elemental…

Numerical Analysis · Mathematics 2025-03-18 Théophile Chaumont-Frelet , Joscha Gedicke , Lorenzo Mascotto

We study the numerical approximation of integrals over $\mathbb{R}^s$ with respect to the standard Gaussian measure for integrands which lie in certain Hermite spaces of functions. The decay rate of the associated sequence is specified by a…

Numerical Analysis · Mathematics 2017-11-16 Josef Dick , Christian Irrgeher , Gunther Leobacher , Friedrich Pillichshammer

In spite of the wealth of literature on the theoretical properties of the Lasso, there is very little known when the value of the tuning parameter is chosen using the data, even though this is what actually happens in practice. We give a…

Statistics Theory · Mathematics 2016-09-02 Sourav Chatterjee , Jafar Jafarov

Multilevel methods represent a powerful approach in numerical solution of partial differential equations. The multilevel structure can also be used to construct estimates for total and algebraic errors of computed approximations. This paper…

Numerical Analysis · Mathematics 2024-05-13 Petr Vacek , Jan Papež , Zdeněk Strakoš