English
Related papers

Related papers: Convex-Geometric Error Bounds for Positive-Weight …

200 papers

We propose an inexact proximal augmented Lagrangian framework with explicit inner problem termination rule for composite convex optimization problems. We consider arbitrary linearly convergent inner solver including in particular stochastic…

Optimization and Control · Mathematics 2019-09-23 Fei Li , Zheng Qu

Kernel quadrature is widely used to approximate integrals of smooth functions, with worst-case error typically decaying at the minimax rate $n^{-\alpha/d}$ for smoothness $\alpha$ in dimension $d$. Existing rate-optimal methods often depend…

Computation · Statistics 2026-05-19 Edoardo Bandoni , Christian Robert , Julien Stoehr

Generalized Disjunctive Programming (GDP) provides a natural framework for optimization models that combine logical decisions with nonlinear constraints. The Hull Reformulation (HR) is attractive because it yields tight continuous…

Optimization and Control · Mathematics 2026-03-18 Sergey Gusev , David E. Bernal Neira

Kernel smoothers are considered near the boundary of the interval. Kernels which minimize the expected mean square error are derived. These kernels are equivalent to using a linear weighting function in the local polynomial regression. It…

Methodology · Statistics 2019-12-03 Alexander Sidorenko , Kurt S. Riedel

Minimizing a convex function over the spectrahedron, i.e., the set of all positive semidefinite matrices with unit trace, is an important optimization task with many applications in optimization, machine learning, and signal processing. It…

Optimization and Control · Mathematics 2016-05-23 Dan Garber

We present tight lower bounds on the number of kernel evaluations required to approximately solve kernel ridge regression (KRR) and kernel $k$-means clustering (KKMC) on $n$ input points. For KRR, our bound for relative error approximation…

Data Structures and Algorithms · Computer Science 2019-05-17 Manuel Fernandez , David P. Woodruff , Taisuke Yasuda

We consider the problem of improving kernel approximation via randomized feature maps. These maps arise as Monte Carlo approximation to integral representations of kernel functions and scale up kernel methods for larger datasets. Based on…

Machine Learning · Computer Science 2018-10-31 Marina Munkhoeva , Yermek Kapushev , Evgeny Burnaev , Ivan Oseledets

This paper establishes error bounds for the convergence of a piecewise linear approximation of the constrained optimal smoothing problem posed in a reproducing kernel Hilbert space (RKHS). This problem can be reformulated as a Bayesian…

Statistics Theory · Mathematics 2025-06-24 Laurence Grammont , François Bachoc , Andrés F. López-Lopera

We present a generic scheme to construct corrected trapezoidal rules with spectral accuracy for integral operators with weakly singular kernels in arbitrary dimensions. We assume that the kernel factorization of the form,…

Numerical Analysis · Mathematics 2012-11-27 Jae-Seok Huh , George Fann

Many inverse problems in nuclear fusion and high-energy astrophysics research, such as the optimization of tokamak reactor geometries or the inference of black hole parameters from interferometric images, necessitate high-dimensional…

Machine Learning · Computer Science 2025-05-09 Jonathan Gorard , Ammar Hakim , Hong Qin , Kyle Parfrey , Shantenu Jha

We investigate convexification for convex quadratic optimization with step function penalties. Such problems can be cast as mixed-integer quadratic optimization problems, where binary variables are used to encode the non-convex step…

Optimization and Control · Mathematics 2025-04-24 Soobin Choi , Valentina Cepeda , Andres Gomez , Shaoning Han

In an ordinary feature selection procedure, a set of important features is obtained by solving an optimization problem such as the Lasso regression problem, and we expect that the obtained features explain the data well. In this study,…

Machine Learning · Statistics 2018-10-16 Satoshi Hara , Takanori Maehara

We consider neural networks with a single hidden layer and non-decreasing homogeneous activa-tion functions like the rectified linear units. By letting the number of hidden units grow unbounded and using classical non-Euclidean…

Machine Learning · Computer Science 2016-11-01 Francis Bach

We introduce a method to numerically compute equilibrium measures for problems with attractive-repulsive power law kernels of the form $K(x-y) = \frac{|x-y|^\alpha}{\alpha}-\frac{|x-y|^\beta}{\beta}$ using recursively generated banded and…

Numerical Analysis · Mathematics 2023-04-05 Timon S. Gutleb , José A. Carrillo , Sheehan Olver

This paper investigates the convergence properties of spectral algorithms -- a class of regularization methods originating from inverse problems -- under covariate shift. In this setting, the marginal distributions of inputs differ between…

Machine Learning · Statistics 2025-09-08 Ren-Rui Liu , Zheng-Chu Guo

While recent work suggests that quantum computers can speed up the solution of semidefinite programs, little is known about the quantum complexity of more general convex optimization. We present a quantum algorithm that can optimize a…

Quantum Physics · Physics 2020-01-15 Shouvanik Chakrabarti , Andrew M. Childs , Tongyang Li , Xiaodi Wu

Panel-based, kernel-split quadrature is currently one of the most efficient methods available for accurate evaluation of singular and nearly singular layer potentials in two dimensions. However, it can fail completely for the layer…

Numerical Analysis · Mathematics 2021-08-04 Fredrik Fryklund , Ludvig af Klinteberg , Anna-Karin Tornberg

In this work we deal with the problem of support estimation under shape restrictions. The shape restriction we deal with is an extension of the notion of convexity named alpha-convexity. Instead of assuming, as in the convex case, the…

Methodology · Statistics 2011-05-31 Beatriz Pateiro-López , Alberto Rodríguez Casal

Kernel density estimators with circular data have been studied extensively for decades, as they allow flexible estimations even when the shape of the underlying density is complex. Many recent studies have examined bias correction methods;…

Methodology · Statistics 2026-03-03 Yasuhito Tsuruta

Kernel balancing weights provide confidence intervals for average treatment effects, based on the idea of balancing covariates for the treated group and untreated group in feature space, often with ridge regularization. Previous works on…

Machine Learning · Statistics 2024-07-08 Rahul Singh