English
Related papers

Related papers: Conservative parametric optimality and the ridge m…

200 papers

We establish optimal convergence rates for a decomposition-based scalable approach to kernel ridge regression. The method is simple to describe: it randomly partitions a dataset of size N into m subsets of equal size, computes an…

Statistics Theory · Mathematics 2014-05-01 Yuchen Zhang , John C. Duchi , Martin J. Wainwright

In this work, we show the consistency of an approach for solving robust optimization problems using sequences of sub-problems generated by ergodic measure preserving transformations. The main result of this paper is that the minimizers and…

Optimization and Control · Mathematics 2020-09-14 Pedro Pérez-Aros

Inexpensive surrogates are useful for reducing the cost of science and engineering studies involving large-scale, complex computational models with many input parameters. A ridge approximation is one class of surrogate that models a…

Numerical Analysis · Mathematics 2019-03-01 Jeffrey M. Hokanson , Paul G. Constantine

We propose a gradient descent method for solving optimization problems arising in settings of tropical geometry - a variant of algebraic geometry that has attracted growing interest in applications such as computational biology, economics,…

Optimization and Control · Mathematics 2025-11-17 Roan Talbut , Anthea Monod

Optimization of frame structures is formulated as a~non-convex optimization problem, which is currently solved to local optimality. In this contribution, we investigate four optimization approaches: (i) general non-linear optimization, (ii)…

Optimization and Control · Mathematics 2019-09-17 Marek Tyburec , Jan Zeman , Martin Kružík , Didier Henrion

We propose a conditional gradient framework for a composite convex minimization template with broad applications. Our approach combines smoothing and homotopy techniques under the CGM framework, and provably achieves the optimal…

Optimization and Control · Mathematics 2018-08-21 Alp Yurtsever , Olivier Fercoq , Francesco Locatello , Volkan Cevher

We investigate an optimization problem that arises when working within the paradigm of Data-Driven Computational Mechanics. In the context of the diffusion-reaction problem, such an optimization problem seeks for the continuous primal…

Numerical Analysis · Mathematics 2025-06-13 Pedro B. Bazon , Cristian G. Gebhardt , Gustavo C. Buscaglia , Roberto F. Ausas

In this work, we present an $\Omega\left(\min\{\log \Delta, \sqrt{\log n}\}\right)$ lower bound for Maximal Matching (MM) in $\Delta$-ary trees against randomized algorithms. By a folklore reduction, the same lower bound applies to Maximal…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-05-22 Seri Khoury , Aaron Schild

Distribution regression seeks to estimate the conditional distribution of a multivariate response given a continuous covariate. This approach offers a more complete characterization of dependence than traditional regression methods.…

Statistics Theory · Mathematics 2025-06-10 Rong Tang , Yun Yang

The numerical methods for differential equation solution allow obtaining a discrete field that converges towards the solution if the method is applied to the correct problem. Nevertheless, the numerical methods have the restricted class of…

Numerical Analysis · Mathematics 2023-07-03 Alexander Hvatov , Tatiana Tikhonova

We propose an adaptive refinement algorithm to solve total variation regularized measure optimization problems. The method iteratively constructs dyadic partitions of the unit cube based on i) the resolution of discretized dual problems and…

Optimization and Control · Mathematics 2023-01-19 Axel Flinth , Frédéric de Gournay , Pierre Weiss

Large optimal transport problems can be approached via domain decomposition, i.e. by iteratively solving small partial problems independently and in parallel. Convergence to the global minimizers under suitable assumptions has been shown in…

Optimization and Control · Mathematics 2021-06-16 Mauro Bonafini , Ismael Medina , Bernhard Schmitzer

Computing supertrees is a central problem in phylogenetics. The supertree method that is by far the most widely used today was introduced in 1992 and is called Matrix Representation with Parsimony analysis (MRP). Matrix Representation using…

Computational Complexity · Computer Science 2011-12-21 Sebastian Böcker , Quang Bao Anh Bui , Francois Nicolas , Anke Truss

We investigate the feature compression of high-dimensional ridge regression using the optimal subsampling technique. Specifically, based on the basic framework of random sampling algorithm on feature for ridge regression and the A-optimal…

Computation · Statistics 2022-04-19 Hanyu Li , Chengmei Niu

Making the gradients small is a fundamental optimization problem that has eluded unifying and simple convergence arguments in first-order optimization, so far primarily reserved for other convergence criteria, such as reducing the…

Optimization and Control · Mathematics 2021-01-29 Jelena Diakonikolas , Puqian Wang

Min-max optimization problems involving nonconvex-nonconcave objectives have found important applications in adversarial training and other multi-agent learning settings. Yet, no known gradient descent-based method is guaranteed to converge…

Machine Learning · Computer Science 2022-10-19 Constantinos Daskalakis , Noah Golowich , Stratis Skoulakis , Manolis Zampetakis

Policy gradient methods are among the most effective methods in challenging reinforcement learning problems with large state and/or action spaces. However, little is known about even their most basic theoretical convergence properties,…

Machine Learning · Computer Science 2020-10-16 Alekh Agarwal , Sham M. Kakade , Jason D. Lee , Gaurav Mahajan

Classically, a mainstream approach for solving a convex-concave min-max problem is to instead solve the variational inequality problem arising from its first-order optimality conditions. Is it possible to solve min-max problems faster by…

Optimization and Control · Mathematics 2025-11-06 Henry Shugart , Jason M. Altschuler

The convergence of stochastic interacting particle systems in the mean-field limit to solutions of conservative stochastic partial differential equations is established, with optimal rate of convergence. As a second main result, a…

Probability · Mathematics 2022-12-15 Benjamin Gess , Rishabh S. Gvalani , Vitalii Konarovskyi

We present a registration method for model reduction of parametric partial differential equations with dominating advection effects and moving features. Registration refers to the use of a parameter-dependent mapping to make the set of…

Numerical Analysis · Mathematics 2023-09-28 Tobias Blickhan