English
Related papers

Related papers: Improved Iteration Complexities for Overconstraine…

200 papers

We consider supervised learning problems within the positive-definite kernel framework, such as kernel ridge regression, kernel logistic regression or the support vector machine. With kernels leading to infinite-dimensional feature spaces,…

Machine Learning · Computer Science 2013-05-23 Francis Bach

We generalize the reduction mechanism for linear programming problems and semidefinite programming problems from [arXiv:1410.8816] in two ways 1) relaxing the requirement of affineness and 2) extending to fractional optimization problems.…

Computational Complexity · Computer Science 2018-10-23 Gábor Braun , Sebastian Pokutta , Aurko Roy

Many important physical problems, such as fluid structure interaction or conjugate heat transfer, require numerical methods that compute boundary derivatives or fluxes to high accuracy. This paper proposes a novel alternative to calculating…

Numerical Analysis · Mathematics 2018-03-12 David Wells , Jeffrey Banks

An adaptive regularization algorithm using high-order models is proposed for partially separable convexly constrained nonlinear optimization problems whose objective function contains non-Lipschitzian $\ell_q$-norm regularization terms for…

Optimization and Control · Mathematics 2021-05-31 Xiaojun Chen , Philippe Toint , Hong Wang

We study the worst-case approximation of multivariate periodic functions from the weighted Korobov space $H_{d,\alpha,\gamma}$ with smoothness $\alpha>1/2$ in the Lebesgue norm $L_p([0,1]^d)$ for $1\le p\le\infty$. We analyze a \emph{median…

Numerical Analysis · Mathematics 2026-03-06 Zexin Pan , Mou Cai , Josef Dick , Takashi Goda , Peter Kritzer

In this paper, we are concerned with a worst-case complexity analysis of a-posteriori algorithms for unconstrained multiobjective optimization. Specifically, we propose an algorithmic framework that generates sets of points by means of…

Optimization and Control · Mathematics 2025-06-16 Andrea Cristofari , Marianna De Santis , Stefano Lucidi , Giampaolo Liuzzi

The aim of this paper is to establish regularity for weak solutions to the nondiagonal quasilinear degenerate elliptic systems related to H\"{o}rmander's vector fields, where the coefficients are bounded with vanishing mean oscillation. We…

Analysis of PDEs · Mathematics 2014-04-28 Yan Dong , Pengcheng Niu

We prove regularity estimates for weak solutions to the Dirichlet problem for a divergence form elliptic operator. We give $L^p$ estimates for the second derivative for $p<2$. Our work generalizes results due to Miranda [28].

Analysis of PDEs · Mathematics 2014-11-17 David Cruz-Uribe , Kabe Moen , Scott Rodney

The iteratively reweighted l1 algorithm is a widely used method for solving various regularization problems, which generally minimize a differentiable loss function combined with a nonconvex regularizer to induce sparsity in the solution.…

Optimization and Control · Mathematics 2021-01-12 Hao Wang , Hao Zeng , Jiashan Wang

We consider the extremal problem of interpolation of convex scattered data in $\mathbb{R}^3$ by smooth edge convex curve networks with minimal $L_p$-norm of the second derivative for $1<p\leq\infty$. The problem for $p=2$ was set and solved…

Numerical Analysis · Mathematics 2022-12-23 Krassimira Vlachkova

We provide improved convergence rates for constrained convex-concave min-max problems and monotone variational inequalities with higher-order smoothness. In min-max settings where the $p^{th}$-order derivatives are Lipschitz continuous, we…

Optimization and Control · Mathematics 2020-07-10 Brian Bullins , Kevin A. Lai

We design and analyze a novel accelerated gradient-based algorithm for a class of bilevel optimization problems. These problems have various applications arising from machine learning and image processing, where optimal solutions of the two…

Optimization and Control · Mathematics 2023-11-20 Sepideh Samadi , Daniel Burbano , Farzad Yousefian

We present a perturbed subspace iteration algorithm to approximate the lowermost eigenvalue cluster of an elliptic eigenvalue problem. As a prototype, we consider the Laplace eigenvalue problem posed in a polygonal domain. The algorithm is…

Numerical Analysis · Mathematics 2021-04-13 Stefano Giani , Luka Grubišić , Luca Heltai , Ornela Mulita

Consider a regression problem where the learner is given a large collection of $d$-dimensional data points, but can only query a small subset of the real-valued labels. How many queries are needed to obtain a $1+\epsilon$ relative error…

Machine Learning · Computer Science 2021-06-29 Xue Chen , Michał Dereziński

We introduce the first iterative algorithm for constructing a $\varepsilon$-coreset that guarantees deterministic $\ell_p$ subspace embedding for any $p \in [1,\infty)$ and any $\varepsilon > 0$. For a given full rank matrix $\mathbf{X} \in…

Data Structures and Algorithms · Computer Science 2026-05-18 Rachit Chhaya , Anirban Dasgupta , Dan Feldman , Supratim Shit

We consider the problem of finding an approximate solution to $\ell_1$ regression while only observing a small number of labels. Given an $n \times d$ unlabeled data matrix $X$, we must choose a small set of $m \ll n$ rows to observe the…

Machine Learning · Computer Science 2021-05-21 Aditya Parulekar , Advait Parulekar , Eric Price

We propose a new estimator for the high-dimensional linear regression model with observation error in the design where the number of coefficients is potentially larger than the sample size. The main novelty of our procedure is that the…

Methodology · Statistics 2019-09-09 Alexandre Belloni , Abhishek Kaul , Mathieu Rosenbaum

We apply Christ's method of refinements to the $\ell^p$-improving problem for discrete averages $\mathcal{A}_N$ along polynomial curves in $\mathbb{Z}^d$. Combined with certain elementary estimates for the number of solutions to certain…

Classical Analysis and ODEs · Mathematics 2020-12-14 Spyridon Dendrinos , Kevin Hughes , Marco Vitturi

$p$-adic linear regression is the problem of finding coefficients $\beta$ that minimise $\sum_i |y_i - x_i^\top\beta|_p$. We prove that computing an optimal solution is NP-hard via a polynomial-time reduction from Max Cut using a…

Computational Complexity · Computer Science 2026-02-17 Gregory D. Baker

In this paper, we prove an extrapolation result for complex coefficient divergence form operators that satisfy a strong ellipticity condition known as $p$-{\it ellipticity}. Specifically, let $\Omega$ be a chord-arc domain in $\mathbb R^n$…

Analysis of PDEs · Mathematics 2020-06-23 Martin Dindoš , Jill Pipher